58 questions
0
votes
1
answer
83
views
WSO2 MI – Error Could not write JSON stream when handling base64 payload
I’m working with WSO2 Micro Integrator and exposing a PATCH API that receives a base64 document in JSON payload, then forwards it to a backend service.
<resource methods="PATCH" uri-...
0
votes
1
answer
50
views
JSONStream fails to find type declarations in CI
I'm using JSONStream and the corresponding type declarations @types/jsonstream.
When running the type check locally (MacOS) it passes, but it fails in github actions CI with "No type declarations ...
- 3,773
0
votes
0
answers
78
views
Covert large JSON files with dynamic schema to csv in Java or shell
I want to covert large JSON files to CSV. The files have multiple JSON objects and can be nested. These files are large (1 to 10 GB), so it would not be possible to load them in memory . Also the ...
- 1,522
-1
votes
1
answer
373
views
large json file reading in nodejs with fs
i have a file almost 500 MB. that is been exported from firebase. now i want to add that data into mysql.
here is the format of json file.
{
"103597192838847432678": {
"...
- 6,493
0
votes
1
answer
682
views
Out-of-memory issue when using JSONStream in NodeJS
I am trying to use JSONStream library in NodeJS to stream json (94mb big) from the http request to a local file. However, the app crashes with out-of-memory error, even though the code is invoked with ...
0
votes
0
answers
145
views
Display a file JSON with vuejs
Within the framework of a web application, I want to browse a JSON file to be able to display the data in a boat on a web interface (without saving it in a data structure as it is quite large (about ...
- 23
0
votes
1
answer
1k
views
How can I handle a JSON streaming GET request using RxJs
I have an API endpoint that streams a JSON response.
Now I want to use RxJs observables to stream the data chunks like this:
And suscribe to the observable in other classes. How can i do it? thanks!
...
- 11
1
vote
0
answers
634
views
Why is writing with JSONStream running out of memory?
I have an application that writes a large array of big-but-not-huge JSON objects to an output file. The objects are created, written, and then discarded (i.e. I don't keep them all around). I am using ...
- 40.8k
1
vote
1
answer
2k
views
How to customize a ReadablerStreamReader to handle the Array JSON
I have user.json (assume that will be a large file, I want to stream read this file, but limit the chunk size).
[
{
"name": "John Doe",
"occupation": "...
- 865
-1
votes
1
answer
2k
views
Fail to parse on a json stream using node-fetch
I run the sample code from node-fetch stream feature.
Sometime it can successfully parse the chunk, sometimes return error msg SyntaxError: Unexpected token { in JSON at position 312
const fetch = ...
- 865
0
votes
1
answer
1k
views
How to process Array of JSON Stream Response in node.js server streaming http resquest
The stream response is form of
[{
"id":0,
"name":name0
}
,
{
"id":1,
"name":name1
}
]
if I use node-fetch stream feature to fetch, iterate the response....
- 865
1
vote
1
answer
1k
views
stream json file from s3 bucket
So, I have uploaded a json file into s3 bucket.
However, when I retrive it using python using a get() method, it gives me a type(str) of the file instead of a json file. If I download it, I can get a ...
1
vote
1
answer
577
views
Firebase Tools: How to avoid "out of memory" errors when setting database with a big JSON file? How to stream JSON via firebase-tools?
We have a GitHub action that copies data from one Firebase project to another using firebase-tools (we are using the latest version, 9.11.0) package:
firebase use fromProject && firebase ...
- 13.9k
0
votes
1
answer
594
views
readline() method is giving error: AttributeError: 'tuple' object has no attribute 'readline'
I am using jsonstreams.Stream method to input data into a json file using Python 2.7 but I am getting an error when trying to read data from the PIPE input using the readline() method. The error ...
- 77
0
votes
1
answer
519
views
Code after pipe is not executing in node js readstream
I have JSON as below
customers.json
{
"customers":[
{ "name": "customer1"},
{ "name": "customer2"},
{ "name&...
- 121