Hello Team, just to follow up, I saw in your GitHub repos like cloud-pricing-api does this API cover also shows the cost of traffic between different regions for cloud providers? or is there another API that can show this

Hello! Infracost CLI can show the cost of traffic between regions for specific resources. The cloud pricing API only provides the prices

Oh, great, that's exactly what I need, thanks for the help

Sure thing 🙂

Vadim, I have seen your infracost CLI it's good, but maybe do you have Rest API or GraphQL which can be called for the cost of traffic between regions for specific resources?

May I ask what is your use-case to understand what exactly can help you?

Yeah, so I have seen for example AWS EC2 those prices https://aws.amazon.com/ru/ec2/pricing/on-demand/#Data_Transfer we can not focus on the type of each instance, but what I need is that I want to retrieve a regional $cost for transferring outgoing data from Amazon EC2 to any regions within AWS per GB, I would also like to keep the cost up-to-date and similarly for other cloud providers and for this purpose I looking like Rest API's, if you have something like that, it would be great

@polite-animal-10151 one workaround you might be able to use just now is to find the Cloud Pricing API filters from the resource files, e.g. this one for data transfer, then pass those filters to the Cloud Pricing API’s GraphQL API, e.g. this example request. This curl call shows an example request being made. The Cloud Pricing API returns uptodate prices so that API call could be repeated when AWS/Azure/Google announce prices changes. I know this is not as easy as having an API that just takes filters and returns the prices as you suggest - hopefully we’ll get to that but we don’t have an ETA. (I’m one of the co-founders, looking after the product side of things, feel free to DM if you want to jump on a call to discuss further)

Thanks Ali, I'll take a look.

Hey! We support AWS, Azure and Google. Let me try this request and see what happens 🙂

ok, thanks it works

Another way might be installing the CPAPI locally. This way you'll have access to the database and can query it using SQL

Thanks, I will take a look. Vadim do you know if you have plan to connect other cloud providers, for example, OCI (Oracle)? if so, maybe you know the approximate dates?

Thanks for asking! This is the sort of thing we'd love to support longer term but our team is currently focused on supporting AWS, Azure and GCP so we prefer not to work on adding new vendors at this time. We would like to move towards a provider model where community-supported cloud vendors could also be added (similar to Terraform providers). There are couple open issues where you can subscribe for updates, but we can't provide any dates right now. https://github.com/infracost/infracost/issues/911

Hey Vadim, a quick question: I see in the request body for AWS we have two fields: service: \"AWSDataTransfer\", productFamily: \"Data Transfer\" but correct me if I'm wrong, for Azure, the name of the service and the product family will be something like this or the name of the service will be different, the same for GCP, for example: service: \"AzureDataTransfer\", productFamily: \"Data Transfer\" service: \"GCPDataTransfer\", productFamily: \"Data Transfer\" and where can I see all the names of services and productFamily name's?

You are correct, the names will differ. We get these names from cloud vendors' price APIs directly and store them as is in the CPAPI database. As the db has millions of prices, it might be very hard to guess them. There are couple ways how to research the proper names: 1. Reading our CLI source code: you can find the resource you're interested in and look at its source code and see what filters its cost components use 2. Install CPAPI yourself and use its database to search through. In the guide I've mentioned before there is an instruction how you can narrow down the search

ok, thanks I will check

Yes

So I'm mostly a technical part and I just touched CPAPI all the organizational issues and the subscription is probably to our mgmt, I'll write them a letter today with my thoughts and I hope that they will contact with you at least they have email hassan.hosseini@infracost.io As for other products, I don't know yet how they will work for us, maybe we will find value

Awesome, thank you! And thank you for your feedback! 🙂

Hey Vadim, quick question I tried to run this request

curl <https://pricing.api.infracost.io/graphql> \

-X POST \

-H 'X-Api-Key: MY_KEY' \

-H 'Content-Type: application/json' \

--data '{"query": "{ products( filter: { vendorName: \"azure\", service: \"Bandwidth\", productFamily: \"Networking\", region: \"eastus\", attributeFilters: [ { key: \"fromLocation\", value: \"US East 2(Virginia)\" }, { key: \"toLocation\", value: \"West US 2 (Washington)\" } ] },) { attributes { key, value } prices { USD } } }"}'

I got {"error":"Invalid API key"}curl: (3) URL using bad/illegal format or missing URL I checked API key it looks ok

Hey! Just checked the same command with my key and it worked 🙂

yep something with formatting , one-line it works

But the error is returned, so this is strange: curl makes a request to API, gets the result, but reports an invalid URL format 🙂

mac

Same 🤔

you know this query

curl <https://pricing.api.infracost.io/graphql> -X POST -H 'X-Api-Key: MY_KEY' -H 'Content-Type: application/json' --data '{"query": "{ products( filter: { vendorName: \"azure\", service: \"Bandwidth\", productFamily: \"Networking\", attributeFilters: [ { key: \"fromLocation\", value: \"US East 2(Virginia)\" }, { key: \"toLocation\", value: \"West US 2 (Washington)\" } ] },) { attributes { key, value } prices { USD } } }"}'

returned empty value {"data":{"products":[]}} maybe I need to add more attributeFilters ?

No products means that your current filters don't find anything

sorry, I'm a little confused about what I saw in azure https://azure.microsoft.com/en-us/pricing/details/bandwidth/ for bandwidth pricing

Try using

value_regex:

instead of `value`:

value

is the exact match, the

value_regex

takes regular expression so you can do partial matches https://github.com/infracost/cloud-pricing-api/blob/master/src/typeDefs.ts#L40

yep Bandwidth | Networking

Looking at the raw data is the only way to know what the actual values are

Vadim for this request:

curl <https://pricing.api.infracost.io/graphql> -X POST -H 'X-Api-Key: MY-KEY' -H 'Content-Type: application/json' --data '{"query": "{ products( filter: { vendorName: \"azure\", service: \"Bandwidth\", productFamily: \"Networking\", attributeFilters: [{key: \"meterName\", value: \"Standard Inter-Region Data Transfer\"}, {key: \"skuName\", value: \"Standard\"}] }) { attributes { key, value} prices { USD } } }"}'

I got this response

{"data":{"products":[{"attributes":[{"key":"meterId","value":"e92d3650-2471-55d2-8433-d8cacd330f70"},{"key":"skuName","value":"Standard"},{"key":"meterName","value":"Standard Inter-Region Data Transfer"},{"key":"productId","value":"DZH318Z0BNVX"},{"key":"serviceId","value":"DZH318FHKQ5W"},{"key":"armSkuName","value":""},{"key":"productName","value":"Rtn Preference: MGN"},{"key":"serviceFamily","value":"Networking"},{"key":"effectiveStartDate","value":"2022-11-01T00:00:00Z"}],"prices":[{"USD":"0.012"}]}

what is this data and what region does it belong to?

This shows the product attributes and prices matched to your request. You would also need to ask GraphQL to return

region

https://github.com/infracost/cloud-pricing-api/blob/master/src/typeDefs.ts#L26

ah, ok thanks for the help

No. CPAPI is currently free to use

Hey Vadim, our DevOps prepared PR, could someone from your team check it out https://github.com/infracost/helm-charts/pull/30

Yep, thank you for the heads up!

@abundant-terabyte-72655 Can we use master branch?

Hi, @busy-agent-35515 We are not cloning or using git approach, we add this as repository link to our helmfile. And this is using a semantic version (i suppose based on git tags).

Hey! I see. Are you able to use helm-git for that? Sorry, I've never used helmfile myself, so not much of a help here 😞 I'm afraid we won't get to the fix until next week, hopefully it's not a blocker for you

It is not a blocker (at least on development side), we can wait. Thank you.

@busy-agent-35515 Maybe do you know approximately when can we expect a new version this week?

Hey, unfortunately, no estimate yet 😞

awesome, thanks.

Great thanks

Looks like CI/CD is happy with the new vision :))

@busy-agent-35515 Hey, maybe you know better who can help us with this issue? We got with deploy of the pod next error maybe we are doing something wrong: Warning Failed 5s (x6 over 63s) kubelet Error: couldn't find key postgresql-password in Secret manager/cloud-pricing-api-postgresql and however we have: kubectl get secret | grep postgres cloud-pricing-api-*postgres*ql Opaque 1 3m34s

@little-author-61621 Have you seen this issue before?

@polite-animal-10151 are you using an external postgresql or the postgresql that’s deployed with the chart?

with the chart

@polite-animal-10151 can you list the content of the env file here (no sensitive data)?

sure in our env file we have:

postgresql:
  existingSecret: cloud-pricing-api-postgresql
  postgresPassword: xxxxxxx
  secretName: cloud-pricing-api-postgresql

What’s in the

cloud-pricing-api-postgresql

secret?

Is the same value of

postgresPassword

So when you deploy does the

cloud-pricing-api-postgresql

secret have the correct value for the password?

Yes, we did last week and it was the right pass. Let’s us to do more tests. Thank you.

@abundant-terabyte-72655 hmm odd… we don’t create a password for the DB, so that’s a value you have to pass in. Have you tried passing in

postgresql.auth.postgresPassword

when installing the helm chart?

@little-author-61621 Thank you very much for your help, we will check

@little-author-61621 i can see all pods are up and running, but on the logs:

{"level":30,"time":1676291116738,"pid":18,"hostname":"cloud-pricing-api-77d59d858f-qjw2p","msg":":rocket:  Server ready at <http://0.0.0.0:4000/>"}
{"level":50,"time":1676291124437,"pid":18,"hostname":"cloud-pricing-api-77d59d858f-qjw2p","msg":"Could not connect to database: Error: connect ECONNREFUSED 10.7.39.139:5432"}
{"level":50,"time":1676291124442,"pid":18,"hostname":"cloud-pricing-api-77d59d858f-qjw2p","msg":"Could not connect to database: Error: connect ECONNREFUSED 10.7.39.139:5432"}

Is it a normal behaviour?

@abundant-terabyte-72655 is the DB pod up and running ok?

cloud-pricing-api-77d59d858f-qjw2p   1/1     Running   0          4m42s
cloud-pricing-api-init-job-ktclb     1/1     Running   0          4m42s
cloud-pricing-api-postgresql-0       1/1     Running   0          4m42s

On Postgres i can see:

2023-02-13 12:25:15.730 GMT [1] LOG:  pgaudit extension initialized
2023-02-13 12:25:15.740 GMT [1] LOG:  starting PostgreSQL 14.5 on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
2023-02-13 12:25:15.740 GMT [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
2023-02-13 12:25:15.740 GMT [1] LOG:  listening on IPv6 address "::", port 5432
2023-02-13 12:25:15.746 GMT [1] LOG:  listening on Unix socket "/tmp/.s.PGSQL.5432"
2023-02-13 12:25:15.754 GMT [154] LOG:  database system was shut down at 2023-02-13 12:25:15 GMT
2023-02-13 12:25:15.765 GMT [1] LOG:  database system is ready to accept connections
2023-02-13 12:26:34.945 GMT [155] LOG:  checkpoints are occurring too frequently (17 seconds apart)
2023-02-13 12:26:34.945 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:26:51.101 GMT [155] LOG:  checkpoints are occurring too frequently (17 seconds apart)
2023-02-13 12:26:51.101 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:27:06.994 GMT [155] LOG:  checkpoints are occurring too frequently (15 seconds apart)
2023-02-13 12:27:06.994 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:27:23.373 GMT [155] LOG:  checkpoints are occurring too frequently (17 seconds apart)
2023-02-13 12:27:23.373 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:27:39.559 GMT [155] LOG:  checkpoints are occurring too frequently (16 seconds apart)
2023-02-13 12:27:39.559 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:27:55.455 GMT [155] LOG:  checkpoints are occurring too frequently (16 seconds apart)
2023-02-13 12:27:55.455 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:28:12.392 GMT [155] LOG:  checkpoints are occurring too frequently (17 seconds apart)
2023-02-13 12:28:12.392 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:28:29.696 GMT [155] LOG:  checkpoints are occurring too frequently (17 seconds apart)
2023-02-13 12:28:29.696 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:28:48.088 GMT [155] LOG:  checkpoints are occurring too frequently (19 seconds apart)
2023-02-13 12:28:48.088 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:29:09.263 GMT [155] LOG:  checkpoints are occurring too frequently (21 seconds apart)
2023-02-13 12:29:09.263 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:29:29.364 GMT [155] LOG:  checkpoints are occurring too frequently (20 seconds apart)
2023-02-13 12:29:29.364 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:29:48.452 GMT [155] LOG:  checkpoints are occurring too frequently (19 seconds apart)
2023-02-13 12:29:48.452 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:30:09.027 GMT [155] LOG:  checkpoints are occurring too frequently (21 seconds apart)
2023-02-13 12:30:09.027 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".
2023-02-13 12:30:29.605 GMT [155] LOG:  checkpoints are occurring too frequently (20 seconds apart)
2023-02-13 12:30:29.605 GMT [155] HINT:  Consider increasing the configuration parameter "max_wal_size".

Is this after a fresh uninstall, removing the PVC and installing?

Actually i recereate the whole cluster. Let me do it again.

Awesome, thanks for trying it!

Is it possible to use a tag (versioning) on github for the helm chart?

Yeah. This is in the tag v0.6.1 now.

awesome (Now i saw it). Thank you a lot for the help.

Hey @busy-agent-35515 I need a little bit of your help, I have this request: curl https://pricing.api.infracost.io/graphql -X POST -H 'X-Api-Key: MY-KEY' -H 'Content-Type: application/json' --data '{"query": "{ products( filter: { vendorName: \"aws\", service: \"AmazonEC2\", region: \"us-east-1\",productFamily: \"Storage\", attributeFilters: [{key:\"regionCode\",value:\"us-east-1\"}, {key:\"servicename\", value:\"Amazon Elastic Compute Cloud\"}] }) { attributes { key, value} prices { USD } } }"}' and I got this response: {"data":{"products":[{"attributes":[{"key":"location","value":"US East (N. Virginia)"},{"key":"operation","value":""},{"key":"usagetype","value":"EBS:VolumeUsage"},{"key":"regionCode","value":"us-east-1"},{"key":"volumeType","value":"Magnetic"},{"key":"servicecode","value":"AmazonEC2"},{"key":"servicename","value":"Amazon Elastic Compute Cloud"},{"key":"locationType","value":"AWS Region"},{"key":"storageMedia","value":"HDD-backed"},{"key":"maxIopsvolume","value":"40 - 200"},{"key":"maxVolumeSize","value":"1 TiB"},{"key":"volumeApiName","value":"standard"},{"key":"maxThroughputvolume","value":"40 - 90 MB/sec"},{"key":"maxIopsBurstPerformance","value":"Hundreds"}],"prices":[{"USD":"0.0500000000"}]} but I can't see the instance type of EC2 because not specified in the response for example "t3a.xlarge" and I can't see it in DB as well, how can I find out what type of instance?maybe I'm doing something wrong

@polite-animal-10151 does it work if you set

productFamily

to

Compute Instance

?

@little-author-61621 Thanks for your help, I didn't notice a little that there are more productFamily for this type. Thank you

For the reference, you can search

attributes

column as a string:

select * from products where "vendorName" = 'aws' and region = 'us-east-1' and attributes::text ilike '%t3a.xlarge%' limit 1

will give you one record where you can see the details

ok, super thanks

Hello, in case i want to

rolling update or upgrade

for the cloud pricing api helm chart, how is the behaviour, will work? Right now, we have one issue when we do helm upgrade for our stack and we get this error.

It seems like we might be missing these job fields

controller-uid

and

job-name

from the init job to support a rolling upgrade. Probably something we can add here: https://github.com/infracost/helm-charts/blob/master/charts/cloud-pricing-api/templates/job-init.yaml#L6-L7 . I’ll raise an issue in the helm chart repo to track and fix. That being said I don’t think we’ll have a fix for this today as the team is heads down on shipping some important features/goals. So we’ll most likely get to this some point next week.

Awesome. No problem. Is not an block for now (we are still in development), is just when we do upgrade.

ok great, as always if you find a fix or want an resolution sooner, feel free to open a PR with contributions infraheart

Sure. Thanks.