No data file for "data/{env}/users.csv" in env "staging" when the common file exists

Example threads. These questions and answers were written by the SDODS team to document real problems and how to fix them. The people named are illustrative, not real users. Questions asked on this site are marked new.

bash

sdods run -p shop -e staging -l ui -t @data-driven

text

✖ DATASET_NOT_FOUND: No data file for "data/{env}/users.csv" in env "staging".
  hint: Tried: /work/shop/projects/shop/data/staging/users.csv, /work/shop/projects/shop/data/common/users.csv

Declared like this:

yaml

data:
  sources:
    users: { type: csv, path: 'data/{env}/users.csv' }

There is no data/staging/ directory, which is fine, that was the plan — every environment was supposed to fall back to the common file. And there is a common file. It is called data/common/logins.csv.

I read the resolution order as "try the env path, then fall back to common", so I expected it to find it.

data config

asked by Annika Solheim

2 answers

Accepted answer
Four candidates get tried, in this order:
1. path with {env} substituted
2. data/<env>/<basename>
3. fallback
4. data/common/<basename>
The basename is taken from the resolved path, so for data/{env}/users.csv it is users.csv in every one of them. Candidate 4 is data/common/users.csv, which does not exist. logins.csv is never a candidate — nothing in the config mentions that name.
Two candidates in the hint rather than four because it de-duplicates, and with no fallback set the list collapses.
Say it explicitly:
yaml
```
data:
  sources:
    users: { type: csv, path: 'data/{env}/users.csv', fallback: data/common/logins.csv }
```
The hint prints absolute paths in the order tried, so it is worth reading top to bottom before changing anything — it usually tells you which of the four you meant.
answered by Priya VenkateshSDODS team
Or rename the file to users.csv and delete the fallback line. Candidate 4 then picks it up for every environment and there is one less thing in the yaml. We keep the rule "the file is named after the dataset" for exactly this reason.
answered by Rafa Garrido

Know the answer?

Wrap commands and output in triple backticks and they will render as a code block.

Checking whether you’re signed in…

Have a different question? Ask it.

No data file for "data/{env}/users.csv" in env "staging" when the common file exists

2 answers

Know the answer?

Related