# Adding more data to the dataset uploaded on HF
**URL:**
**Author:**  [@elsaEU](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FelsaEU)%5C
**Post date:** [December 28, 2023, 10:58am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fadding-more-data-to-the-dataset-uploaded-on-hf%2F67263%2F1 "2023-12-28T10:58:33Z")
Hi,
I want to add more data to my dataset ELSA\_D3:
> **[elsaEU/ELSA\_D3 · Datasets at Hugging Face](https://huggingface.co/datasets/elsaEU/ELSA_D3)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Note that the filenames are:
```auto
train-0-05239
...
train-05239-05239
```
Can I add more parquet without re-upload all the files and automatically correct the readme metadata?
My currently upload procedure is:
- Convert images to arrow files and store them on disk in N split
- Load in memory the N splits using datasets.concatenate\_datasets()
- Push using datasets.push\_to\_hub()
Now I would like to concatenate another split and upload it without losing the previous data and without messing up with filenames
Thanks
---
**Author:**  [@severo](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsevero)%5C
**Post date:** [January 2, 2024, 4:59pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fadding-more-data-to-the-dataset-uploaded-on-hf%2F67263%2F2 "2024-01-02T16:59:27Z")
cc @lhoestq @mariosasko
---
**Author:**  [@lhoestq](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Flhoestq)%5C
**Post date:** [January 4, 2024, 5:35pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fadding-more-data-to-the-dataset-uploaded-on-hf%2F67263%2F3 "2024-01-04T17:35:10Z")
You can `push_to_hub` to a different split, and then manually modify the YAML in the README.md header to group the `data_files` together in the same split.
For example:
After pushing a new split `train_part2` you ill get:
```yaml
configs:
- config_name: default
data_files:
- split: train
path: default/train-*
- split: train_part2
path: default/train_part2-*
```
and you can group the splits together this way:
```yaml
configs:
- config_name: default
data_files:
- split: train
path:
- default/train-*
- default/train_part2-*
```
You’d also have to update the `datasets_info` in the YAML to account for the new split size and number of examples (or just delete it)
---
**Author:**  [@elsaEU](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FelsaEU)%5C
**Post date:** [January 15, 2024, 1:40pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fadding-more-data-to-the-dataset-uploaded-on-hf%2F67263%2F4 "2024-01-15T13:40:03Z")
Thank you, it works fine.
---
**Author:**  [@system](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsystem)%5C
**Post date:** [January 16, 2024, 1:40am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fadding-more-data-to-the-dataset-uploaded-on-hf%2F67263%2F5 "2024-01-16T01:40:21Z")
Closed on January 16, 2024, 1:40am UTC
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.