Hello I have a situation where I m doing a breakdown on my d

Question

Hello I have a situation where I m doing a breakdown on my default branch then a breakdown on my feature branch then I m doing a diff and I m getting the error `Invalid compare to Infracost JSON found duplicate project name ` What exactly does this mean

kind-angle-62935 · Answer

I m getting that error on the diff

little-author-61621 · Answer

< kind angle 62935> can you share the commands you are running for breakdown and diff I ll be able to have more of a look in about an hour

kind-angle-62935 · Answer

< little author 61621> Here is where I create the breakdown based on the base branch and here is where I do the breakdown on the feature branch and the diff

little-author-61621 · Answer

So this error appears if you have multiple projects in your Infracost JSON that have the same project name Since Infracost is unable to distinguish between them then when it is doing the diff it can t tell which one to diff against So I m wondering what the config file looks like or the Infracost output JSON that means that there s two projects with the same name

kind-angle-62935 · Answer

< little author 61621> What does two projects with the same name mean exactly Is only the `diff` checking this Should `breakdown` fail in this case

little-author-61621 · Answer

It means two projects in the `prev infracost` JSON file have the same `name` key The diff is checking this because it assumes unique project names otherwise it doesn t know which one to diff against Are you setting project names in the config file when you create it

kind-angle-62935 · Answer

The template for the config I m making looks like <https github com terrateamio action blob main terrat runner infracost py L20>

kind-angle-62935 · Answer

I am not setting project names

little-author-61621 · Answer

ok do any of the `dirspaces` have the same path and workspace

kind-angle-62935 · Answer

I will double check but no they should not

kind-angle-62935 · Answer

That tuple should be unique

little-author-61621 · Answer

the name it is showing in the ` ` here `found duplicate project name ` is the one it s finding twice

kind-angle-62935 · Answer

Yes I m trying to setup a test for this But since I m not specifying a project name how is infracost assigning a project name that would be duplicated

little-author-61621 · Answer

Infracost defaults the name based on the path and the workspace So the name it s generating should be ` lt path gt Workspace lt workspace gt `

kind-angle-62935 · Answer

Does it not include that if the workspace is `default`

kind-angle-62935 · Answer

Does it not include the workspace part I mean

little-author-61621 · Answer

correct it just uses the path for that case

kind-angle-62935 · Answer

Thank you I ll try some things

little-author-61621 · Answer

You can set your own project name by specifying a `name` key for each project in the config file if you want as well

kind-angle-62935 · Answer

< little author 61621> How does infracost handle a configuration like ```projects path foo terraform workspace default path foo bar terraform workspace default```

little-author-61621 · Answer

Ah that might be causing the problem If `foo` is a Terraform mono repo then it will create a new project for each project underneath it and so there might be two created for `foo bar`

kind-angle-62935 · Answer

I think that is what I m seeing

kind-angle-62935 · Answer

Is there any way to tell it to not be recursive

kind-angle-62935 · Answer

Could I set an exclude path for anything underneath

little-author-61621 · Answer

There s `exclude paths` <https www infracost io docs features config file usage> does that help

kind-angle-62935 · Answer

A non recursive flag would be preferred but I might be able to work with exclude paths

kind-angle-62935 · Answer

Would this work ```projects path foo terraform workspace default exclude paths foo path foo bar terraform workspace default exclude paths foo bar ```

little-author-61621 · Answer

It could work it s not something I ve used much so I can t say for sure My bigger question is why do you need to specify all the sub paths separately

kind-angle-62935 · Answer

Because it s a monorepo we have precise control over what we consider a terraform dir and what we don t

little-author-61621 · Answer

Okay so if you pass the parent directory to Infracost it doesn t properly detect the terraform dirs

kind-angle-62935 · Answer

We have our own tooling which detects what the terraform dirs are and which ones we want to run various operations on

kind-angle-62935 · Answer

Hrm excluse paths does not seem to work

kind-angle-62935 · Answer

`exclude paths`

kind-angle-62935 · Answer

< little author 61621> If i were to manipulate the output JSON to remove dup projects would `diff` work fine Or does it depend on the `summary` information in a `breakdown` to be correct

little-author-61621 · Answer

yeah that could work Another option could be to set the `name` manually in the config file

kind-angle-62935 · Answer

Well a question `breakdown` is producing duplicate entries in the output but does that mean the summary contains the duplicate values

kind-angle-62935 · Answer

Or rather does the summary have the a duplicate sum

kind-angle-62935 · Answer

< little author 61621> I created an Issue as well

little-author-61621 · Answer

Sorry for the slow response thanks for creating an issue The summaries will probably still contain duplicates if you modify the JSON directly yeah Just trying to understand a little more Are there ` tf` files directly in both ` foo` and ` foo bar` And are there directories under ` foo` you aren t wanting to generate Infracost results for

kind-angle-62935 · Answer

Yes and possibly yes

little-author-61621 · Answer

Maybe try ``` exclude paths ``` This seems to work for me The exclude paths is relative to the path parameter

kind-angle-62935 · Answer

Ah ok I ll try

kind-angle-62935 · Answer

< little author 61621> Sorry for the long delay and I know it s weekend so no rush getting back to me but `exclude paths` did not work either ```projects exclude paths path non prod terraform workspace default exclude paths path non prod us east 1 terraform workspace default exclude paths path non prod us east 1 qa terraform workspace default exclude paths path non prod us east 1 qa mysql terraform workspace default exclude paths path non prod us east 1 qa webserver cluster terraform workspace default exclude paths path non prod us east 1 stage terraform workspace default exclude paths path non prod us east 1 stage mysql terraform workspace default exclude paths path non prod us east 1 stage webserver cluster terraform workspace default version 0 1 ```

little-author-61621 · Answer

Okay this is odd here s some ideas to debug it further 1 It would be good to see the output of `tree` on this directory 2 What is the output of running `infracost breakdown config file=infracost yml format=json | jq r projects name ` 3 What is the output of `INFRACOST PARALLELISM=1 infracost breakdown config file=infracost yml format=json log level=debug 2 gt amp 1 | grep walking path |skipping directory ` 4 If you run with just the first project i e ``` projects exclude paths path non prod terraform workspace default ``` What is the output of the above commands from 2 amp 3 Random idea that might work for just now Is there any way of flattening the directories yourself before running Infracost i e having `non prod` `non prod us east 1` `non prod us east 1 qa` I know this isn t ideal just an idea for a workaround

kind-angle-62935 · Answer

< little author 61621> I edited the JSON file and removed all duplicate path workspaces and that seems to be working as expected It looks like diff recalcualtes the summary values on its own