Questions tagged [data]
Data are values of qualitative or quantitative variables, belonging to a set of items. Data in computing (or data processing) are represented in a structure, often tabular (represented by rows and columns), a tree (a set of nodes with parent-children relationship) or a graph structure (a set of interconnected nodes).
460 questions
1
vote
1
answer
147
views
How Should Services and Presentation Layers Share Data in Web Applications?
Lately, I’ve been studying the fundamentals of Software Architecture for web applications, and I’m a bit unsure about how the data and presentation layers should interact.
From what I understand, the ...
- 97
2
votes
1
answer
104
views
Is there any idea to display the progress information when the data is synchronized?
I need to use TypeScript (Node.js) to implement a library for data synchronization.
The logic diagram is as follows:
If we directly execute according to this logic, the synchronization can be ...
- 131
4
votes
1
answer
338
views
When do regression models outperform naive methods?
Case1:
I have the following task to do: Training by the consecutive 3 days to predict the each 4th day. Each day data represents one CSV file which has dimension 24x25. Every datapoints of each CSV ...
- 37
1
vote
1
answer
117
views
Can DAO parse local files?
We need to retrieve data in the form of entities
We have DAOs that hit a DB
But sometimes we need to parse (local) XMLs to retrieve essentially the same entities
Should we have a separate type for ...
- 2,030
0
votes
3
answers
275
views
Architecture for downloading large number of large images
I am running a website for a customer who has terrabytes worth of images. Each JPG image is high-res (20MB) and belongs to a hierarchy like this:
Group A
SubGroup 1
subsubgroup a
...
- 1,701
0
votes
1
answer
245
views
Why is it called Data-Oriented Design?
I find the name data-oriented design very confusing - it sounds like data-driven development (letting hard data determine decisions in development) or data-driven programming (control flow determined ...
- 111
1
vote
1
answer
194
views
Architecture for a system where users want to use Excel for collecting and merging data
My organization handles batches of stuff that need to be checked by Quality Control. What I need is something for the people who work in Quality Control to be able to register and input data inside ...
-1
votes
2
answers
167
views
How do you update a GUI table after DB ops?
I have a DAO that removes rows from a DB table. I have a GUI table representing some of those rows that passes user requests for deletion to that DAO
How should I update the GUI table?
I could attach ...
- 2,030
1
vote
1
answer
148
views
Single-source data warehouse permissions management
We (Data Platform team) are reviewing how we configure and apply permissions against our data warehouse objects, and I'm curious what tools or custom systems you might be using for this.
For context ...
- 21
1
vote
4
answers
374
views
How to decide between keeping data within the code or in a database
As an example, we have an entity called Invoice which has bills of purchased services.
public class Invoice
{
private readonly List<Bill> _serviceBills;
public string InvoiceId { get; }
...
- 319
1
vote
1
answer
191
views
Persisting data in a mobile app backed by a rest API back-end, advices [closed]
So I am working on this mobile application using MAUI, which is backed by a Rest API in ASP.NET Core.
I want to be able to use the app offline, and the user can create/edit some data. This data is ...
- 155
7
votes
3
answers
2k
views
Prevent analytics from crashing the production database
At the core of my business (say, an online store) is a Postgres database that stores products and transactions. During day-to-day operations, the load on the database is not heavy.
However, there is ...
1
vote
1
answer
167
views
How to approach converting to and from kafka messages?
I would like to have a series of small stand-alone services that would either consume a Kafka topic and output the data into a different system or the reverse: receive data from a system and produce ...
- 11
0
votes
1
answer
163
views
Storing Data For Consumption in Python
I have a program which needs some constant data, in JSON-like format. However, this data only needs to be consumed by my Python program, and by making it Python code, I can include types like datetime....
- 111
1
vote
3
answers
902
views
How do you test whether schema changes will break services?
I maintain a relational database of sorts, and occasionally a feature request requires a schema change (eg. add a new column, etc...).
However, a number of "services" consume this data. It's ...
- 343