Of the csv and the values.well, the values ^_^.įlattened_json (dict): Flattened JSON object. The JSON file that I'm trying to convert is 60 GB and I have 64GB of RAM.įlatten a simple JSON by prepending a delimiter to nested children.ĭelim (str): Delimiter for nested children (e.g: '.')ĭef write_json_to_csv(flattened_json, csv_path): (perhaps not load everything at once into memory - even if it's gonna be slower). I'd like to improve the performance of my solution as much as possible. As you can see, my solution is not memory efficient since I'm reading all the file into memory. I won't describe the functionality in too much detail since I have reasonable docstrings for that. If you're ready to go further and learn what you can do between the read and write phases, go ahead and read the 10 minutes to bonobo tutorial.Simply take a JSON file as input and convert the data in it into a CSV file. Now, you can use bonobo run to execute it.

Create a convert_json_to_csv.py file, and paste the following code: import bonobo graph = bonobo.Graph( bonobo.JsonReader('input.json'), bonobo.CsvWriter('output.csv'), ) if _name_ = '_main_': n(graph) Here is an equivalent transformation to the command line example above. $ bonobo convert -r json input_file -w csv output_file Need more? Write your first transformation! $ bonobo convert -reader json input_file -writer csv output_file csv), you can provide input format, output format, or both as optional arguments in the command line. If bonobo can't detect your source file format (or your output does not end by. Simple as hell, just give the input and output file names to bonobo convert and you're good to go. ( read about more installation options in the documentation) Convert JSON to CSV from command line To know if bonobo is installed, you can run bonobo version (and it should be at least 0.5) $ pip install bonobo If you never used bonobo, you first need to install it. You do not need to know Python to use bonobo convert, only how to use a shell and have a shell where you can install python packages. You can use it from command line to convert a JSON file into CSV, or create a transformation if you need more flexibility or different transformation steps. Bonobo can be used to convert files from and to various data sources and file formats.

Convert json file to csv