Questions tagged [archive]
The archive tag has no summary.
117 questions
0
votes
1
answer
104
views
MSSQL Data retrieval logic
I have two tables that store similar data but for different time periods:
MainTable: contains records for the current year.
ArchiveTable: contains records from previous years.
Both tables have a ...
1
vote
2
answers
276
views
How to solve "Space allocator cannot allocate page in database" error
When I insert data into a SQL Server database, I got this error
Space allocator cannot allocate page in database
Even though I have enough space for the disk. Database size is 33 TB. And data is ...
0
votes
1
answer
268
views
PRUNE LOGFILE PRIOR TO isn't deleting archived log files
DB2 UDB 11.5.7.0
$ db2 get db cfg for PRPT01D | grep LOGARCH
First log archive method (LOGARCHMETH1) = DISK:/udb/alogs/
Archive compression for logarchmeth1 (LOGARCHCOMPR1) = OFF
...
0
votes
1
answer
241
views
PostgreSQL: Best practises for Deleting huge volume of Data in Replicated Environment
We have a prod database (PostgreSQL13) with a hot-standby(physical replication) as well as logical replication to a different subscriber server. Now we are in requirement of purging few year's record ...
0
votes
1
answer
64
views
Manage the amount of data on tables
I can have several tables with 10+ millions rows in by year.
I would to know what's the best approach to maintain responsiveness with this amount of datas and I have two ideas.
Don't touch these ...
0
votes
0
answers
64
views
SQL Server database migration issues
I have a system with two servers and three client workstations. Servers were configured to work as principal/mirror servers (mirroring was configured with certificates). I have two databases in SQL ...
1
vote
2
answers
8k
views
Best Practices to archive or remove old data in SQL Server 2012
Our application has numerous tables that contain outdated data, some dating as far back as 2010. Despite having indexes defined on these tables, many of the index seeks retrieve old records, which is ...
0
votes
2
answers
362
views
Pt-archiver csv double quote missing for some fields
I am trying to use pt-archive to archive my database. Below is my script for the archiving process.
pt-archiver --source h=localhost,D=***,t=** --user=*** --password=**** --where "dateTime<'...
1
vote
1
answer
146
views
data archival postgres
I have this code to delete rows with column "id". I want to limit the number of rows deleted in each loop. This code deletes the first 25k rows and the next loop deletes nothing since its ...
1
vote
0
answers
513
views
"Snapshot" of Historical Data for Analysis Purposes
I pull monthly aggregate data from a SQL database. I store the aggregated data in a separate table in the same database (so I can quickly grab numbers from six months ago, for instance).
My issue is ...
0
votes
1
answer
2k
views
Archiving SQLite DB with WAL mode
I have an SQLite database gapongasi.db configured using WAL mode and I want to have daily archive with tar(1). With WAL, there are two files being used (1) gapongasi.db-wal and (2)gapongasi.db-shm, ...
0
votes
1
answer
2k
views
understanding pg_wal and archiving
So I inherited this database. At the very beginning, there were already some files on pg_wal.
Then, after some weeks, I do count SELECT COUNT(*) FROM pg_ls_dir('pg_wal') WHERE pg_ls_dir ~ '^[0-9A-F]{...
0
votes
1
answer
157
views
Why is a Move and Delete Data (approx 1/3 of the table) using (CTEs) WITH statements taking hours on a 600m row table taking 3+ hours - best approach?
Am not sure if this is the best method of moving/deleting data. The play table has 700m+ rows and game table has over 600m+ rows.
I have 2 tables play and game, information from the play table is ...
1
vote
3
answers
2k
views
Database archiving strategy
I work on a payment system (a bit regulated area with requirements to store really old data for audits & customer requests).
We have SQL Server 2016 (but will move to 2019 soon).
System is 16 ...
1
vote
1
answer
749
views
Best way for archiving old mysql records
we have a Ruby on Rails app with a MySQL DB (on AWS RDS). Some of our tables have a large number of records ~100 million and this number is rapidly increasing every month. Most of the records in these ...