Skip to main content

You are not logged in. Your edit will be placed in a queue until it is peer reviewed.

We welcome edits that make the post easier to understand and more valuable for readers. Because community members review edits, please try to make the post substantially better than how you found it, for example, by fixing grammar or adding additional resources and hyperlinks.

Required fields*

4
  • 2
    You only expect to do this once? Use whatever gets the job done fastest. Commented Dec 22, 2023 at 16:34
  • For the current task I plan to do it only once, but I imagine that I'll have to perform similar tasks in the future. Thanks for the insight though, its definitely a viable option. Commented Dec 22, 2023 at 17:32
  • "properly model the data" without even a hint what that means leaves a door open big enough to drive a Bagger 288 through. Commented Dec 22, 2023 at 21:49
  • 1
    load it all into sql and then work on it. The reason being, you will want to report on the errored lines. having the raw data in a "rawData" table makes it easy to say "couldn't parse row 123" and work out what the issue is, rather than errored on line 12312412, col x start again! Commented Dec 22, 2023 at 22:01