Skip to content

Latest commit

 

History

History

firestore-incremental-capture-pipeline

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
src/main/java/com/pipeline
src/main/java/com/pipeline
 
 
target
target
 
 
.gitignore
.gitignore
 
 
README.md
README.md
 
 
pom.xml
pom.xml
 
 

README.md

Debug the pipeline locally

To debug this pipeline locally, use the DirectRunner:

Note: If your Cloud Storage bucket was provisioned after September 30, 2024 the default bucket name will be suffixed with .firebasestorage.app instead of .appspot.com

mvn compile exec:java \
    -Dexec.mainClass=com.pipeline.RestorationPipeline \
    -Dexec.args='--timestamp=1697740800 --firestoreCollectionId="test" --firestoreDb="test" --tempLocation="gs://PROJECT_ID.appspot.com" --project="PROJECT_ID"'

Arguments

  • timestamp: The timestamp to restore the data to from a PITR, if it's further than 7 days in the past, it will be set to 7 days in the past. The timestamp is in UNIX seconds.
  • firestoreCollectionId: The collection to restore, use * if you want the full database.

Compile JAR to run on Dataflow

mvn clean package -DskipTests -Dexec.mainClass=com.pipeline.RestorationPipeline