This message was deleted.
# help
b
This message was deleted.
m
{"level":50,"time":1673524751518,"pid":105,"hostname":"cloud-pricing-api-init-job-tm9db","msg":"There was an error decompressing the file: unexpected end of file"}
• I am deploying on minikube cluster • Deployment using yaml manifests • valid infracost API key • valid self-hosted API key
@here kindly help
b
Hello! Hm, looks like the file was not properly downloaded. I've just tried to update the db locally, and it worked okay, without kube though.
Have you retried, does it happen every time? My first guess would be to check if there is enough space for the pod to download the file
Current archive size would be 316MB, and unzipped - 3.8GB
m
Hello Vadim, I tried and retried several times now, but no luck. Do you want me to share the POD manifest ?
yes, and it is happening everytime now
The init job takes about 25 mins to complete so to wait and see it fail is super frsutrating
b
Oh, maybe it times out and doesn't finish the download
It needs to download 316MB
Is your internet speed fast?
It's strange that it takes 25min
m
Yes, the internet connection is fine. Everytime the successful deployment used 25 mins on the init-job
How can reach to the error which is restricting the csv download
what path does the products.csv.gz gets inflated and saved to ?
init-job pod exec
b
It should live in
./data/products/products.csv.gz
You can provide
LOG_LEVEL=debug
env var or
job.logLevel
for helm chart to see more details, for example, the download URL
I see the file on your screenshot, if you could run
ls -al data/products
we would see the size of the archive
m
I’ve deleted that deployment, and starting fresh again.
👍 1
b
Hm. Looks like 100mb
ls -halp
would show in mbs, but yeah, looks like it doesn’t download the full file
m
Screenshot of pod logs of the failed init-job pod, everytime the same error wrt to decompressing.
should I be using a different image (tag/version)
@busy-agent-35515 really appreciate you sticking with me here, but am short of avenues to troubleshoot 😄
b
Of course 🙂 Sorry I'm not much of a help yet, I wonder why it's that slow and still fails to finish the download
m
the data is getting in but failing to decompress
b
I'm not sure the file is complete. When I downloaded it, it was 316MB for me, but it is 185 for your
m
its still going on
b
If it's incomplete, then it won't be unarchive
What are your minikube settings? How many cpus/memory does it have?
m
315.6M
b
Ah, okay, so we get the full file. That's good
m
but fails again :s not sure why
b
Okay, can you try to
gunzip
it?
Let's see if we can manually uncompress it
m
would it work on failed POD as well ?? I purposely did not exit out of the container shell, and executed gunzip now, but either its stuck or its running the process
b
Hm
m
and we success on manually uncompress
b
Huh, so it's slow, but working
m
so the pod errors out before the download and uncompress ??
b
How do you install the app? Are you using our helm chart?
m
Nope, yaml manifests
my manager wants to avoid helm
b
I see, may I ask why? 🙂
m
hahaha he is just not a helm fan
b
Okay, got it 🙂
m
so no helming across the project
🥲 1
b
Okay, then yeah, if possible, could you please share your manifest? Maybe there are clues there 🙂
m
sure
b
You can use a DM to not share it here, if you want 🙂