Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
BitAstronaut
Mar 7, 2024

Hughmoris posted:

For those of you currently working as Data Engineers, what does your day-to-day look like? What technologies are you working with?

For context, I'm currently a junior data engineer working in finance - graduated two years ago. My day-to-day is usually something along the lines of

- Company wide standup (Mondays only)
- Go over any code reviews I have and make notes ahead of my morning standup
- Morning standup with my team where we go over what we accomplished, what we are doing for the day, and any blockers we may have
- I'll join the debug session immediately following the standup if I have anything to go over.
- Work on my current tasks.

We also have an on-call rotation for seven day periods where your days are usually restarting Airflow DAGs, dealing with data issues, and answering questions from the business.

We use Airflow for orchestration, dbt, Postgres, K8s, and a ton of in-house tooling using Python and Java.

Adbot
ADBOT LOVES YOU

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply