Software Engineer

Pluralsight

Posted: 1 year ago
Openings: 1
Applicants: 0

Job Description

A Data Engineer builds and maintains the infrastructure essential to delivering high-volume, business-critical data to the organization to enable data-driven decisions. They are focused on expanding curated and modeled data that unify sources of truth across our multiple products and domains. Who you re committed to being: Contribute to Data Warehouse models and curation Support the evolution of data environment to deliver high-quality data, speed, and availability Assist in the curation of source-system data to deliver trusted data sets Provide input and involvement on data cataloging and data management efforts Be involved in production ETL performance tuning and environment-level resource consumption and management Drive the migration of POC pipelines to production data processes What you ll do: Experience in designing and delivering data warehouses and marts to support business analytics, as well as designing and developing data curation and integration processes Experience in SQL development on RDBMS and performance tuning Experience with streaming & real-time data processing using a technology like Spark, showflake, Kafka, ksqlDB, or Databricks, etc. Experience with dimensional data modeling/data workflow diagrams (conceptual, logical, and physical) Experience with dimensional data modeling/data workflow diagrams (conceptual, logical, and physical) Experience with source control and deployment workflows for ETL (dbt, Fivetran, github actions, gitlab, airflow, etc.) Experience working with AWS services such as DynamoDB, Glue, Lambda, Step Functions, S3, CloudFormation Experience you ll bring: Experience in Snowflake and Postgres preferred Experience with streaming & real-time data processing using a technology like Spark, showflake, Kafka, ksqlDB, or Databricks, etc. Experience with source control and deployment workflows for ETL (dbt, Fivetran, github actions, gitlab, airflow, etc.) Requirements: Requires a minimum of 2 years of related or equivalent experience; a Bachelor s degree, or an advanced degree without experience.