478 questions
0
votes
2
answers
218
views
Optimizing Spark Joins: How to Perform Multiple Left Joins Without Additional Shuffling
Let's say I have a 2 DataFrames:
First is tickets which has 3 columns:
account_id
assignee_id
requester_id
And I have a second DataFrame users with 3 columns:
account_id
id
name
I would like as an ...
1
vote
0
answers
206
views
Laravel + api platform and snake case
I'm using Laravel and API platform (https://api-platform.com/).
By Laravel convetion and mysql convetion column names in table should be snake_case, but API platform requires camelCase. I found this
...
3
votes
2
answers
233
views
SQL table with thousands of columns
I need to store data(float) from 20,000 sensors once a second. I originally wanted to create the following table:
time
sensor 1
sensor 2
...
sensor 20000
2024-09-06 13:00:00
1.2
5.3
....
2.0
But then ...
0
votes
1
answer
112
views
Dynamic mapping arbitrary delimited files to single Json structure in ADF
I am looking for help implementing a “know nothing” import and load routine in Azure. Input would be, load-over-load, an arbitrary delimited file of N columns and M rows. Output would be to a Json ...
0
votes
0
answers
52
views
How to properly index by (UNIX) day (epochDay) a denornmalized database
It is impossible to keep a UNIX "universal anchor" for days (LocalDate.now().toEpochDay()) like the way UNIX-time does, since the days of ALL the different regions heavily overlap on top of ...
1
vote
2
answers
1k
views
How to denormalize a DateTime-Array to DateTime-Object with Symfony Serializer
I need to denormalize this data with symfony 6
array:4 [
"createdAt" => array:3 [
"date" => "2024-01-09 17:04:37.209330"
"timezone_type" => 3
...
1
vote
1
answer
192
views
How do I model data containing movie titles to retrieve a list of movies by genre?
I have a question regarding data modeling in cassandra. I want to create a cassandra database with movies, actors, ratings etc. I already defined what my tables should look like and I want to create ...
1
vote
2
answers
903
views
How should I store nested JSON object inside Cassandra?
This is the first time I am working with Cassandra and I have a data structure like following, want to save it inside the Cassandra:
{"user_id": "123",
"user_cards": {
...
3
votes
0
answers
485
views
Is denormalization more useful in big query?
Is denormalization more useful in BigQuery given that BigQuery does not support indexing? In a traditional RDBMS we can index columns, or use foreign keys, to speed up JOINs, thus making ...
0
votes
1
answer
114
views
What am I doing wrong with this query
Good evening, I'm currently working on an SQL case study that involves solving this problem.
What is the total quantity of each ingredient used in all delivered pizzas sorted by most frequent first?
...
2
votes
3
answers
3k
views
Error with Symfony Serializer can't normalize int to float
I get an error when I try to denormalize an object with a float attribute but an int value.
Symfony\Component\Serializer\Exception\NotNormalizableValueException:
The type of the "solde" ...
-1
votes
2
answers
302
views
Surrogate keys in star schema hierarchy dimension
Is it necessary to have surrogate keys for each hierarchy level above the lowest level in a dimension table?
Row City_Key City_Name State
1 1234 Chicago Illinois
2 3245 ...
1
vote
0
answers
227
views
How to filter multiple fields from Firestore - React JS - Thinking of denormalization
I've been breaking my head thinking about a way to do this so I'll try to be as specific as possible.
I have an application where a user can upload a report of a lost, found or up for adoption pet. ...
0
votes
2
answers
952
views
MySQL select value range within a value range, from a dash-separated column value?
How do I select a value range from a column where two values in it are separated by a dash, using MySQL?
Here's my example table named "example":
The user enters a low value (X) and a high ...
-2
votes
2
answers
287
views
Denormalize column
I have data in my database like this:
Code
meta
meta_ID
date
A
1,2
1
01/01/2022 08:08:08
B
1,2
2
01/01/2022 02:00:00
B
null
2
01/01/1900 02:00:00
C
null
3
01/01/2022 02:00:00
D
8
8
01/01/2022 02:00:00
...