Data Engineer
Tasks
- Analyze ETL workflows recommend redesign simplify consolidate optimize replace legacy logic
- Assess impact of source system application database business rule changes on ETL warehouse processes
- Build data validation and reconciliation processes for data quality
- Collaborate with BI developers ensure pipelines support semantic models reports dashboards
- Create maintain technical documentation ETL designs data models job flows transformation rules deployment procedures
- Design develop test deploy maintain enterprise ETL data integration processes
- Design support analytical data warehouse dimensional models star schema snowflake schema data marts
- Develop batch and incremental data loads extract transform load
- Develop maintain source to target mappings transformation specifications load rules dependencies documentation
- Develop maintain transformation logic using SQL PL SQL ETL tools scripting
- Develop restart recovery exception handling logging audit monitoring for production ETL
- Implement slowly changing dimensions surrogate keys historical tracking lookup reference data patterns
- Modernize legacy ETL technologies for maintainability
- Optimize ETL processing performance scalability reliability maintainability SQL tuning parallel execution bulk processing
- Participate in testing defect resolution data reconciliation release migration production validation
- Support scheduling orchestration ETL workflows dependencies batch jobs downstream reporting
- Troubleshoot failed ETL jobs data quality issues transformation errors missing duplicate records schema changes
Perks/Benefits
Skills/Tech-stack
Batch Processing | Data Governance | Data Lineage | Data Marts | Data Quality | Data Reconciliation | Data Validation | Data Warehousing | Dimensional Modeling | ETL | Incremental loading | Job Scheduling | Materialized views | Metadata Management | Oracle Analytics | Oracle Database | PL/SQL | Parallel processing | Partitioning | SQL | SQL Tuning | Slowly Changing Dimensions | Snowflake Schema | Star Schema | Stored Procedures | Surrogate keys | Workload Orchestration
Education
Roles
Related jobs
-
Senior Data Engineer USD 195K-352KAWS | Apache Airflow | Apache Spark | Batch Processing | Cloud platformCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeAustin, Texas R1d ago
-
Data Engineering Lead USD 174K-220KAmazon Redshift | BI reporting | DBT | Data Modeling | Data Monitoring401k | Health coverage | Hybrid work environment | Paid parental leave | Paid time offSenior-level Full TimeNew York R1d ago
-
Staff AI Engineer, GenAI USD 200K-230KAgentic AI | Apache Spark | Azure DevOps | Azure ML | CI/CDPaid caregiver leave | Paid sick leave | Paid vacationSenior-level Full TimeUSA - NY - Remote, United … R1d ago
-
Engineer III - Platform Data Engineer (Remote) USD 120K-180KAWS | Access Management | Apache Airflow | Apache Superset | AzureCompetitive vacation and holidays | Employee networks and volunteering | Paid adoption leave | Paid parental leave | Professional development opportunitiesSenior-level Full TimeUSA NY Remote, United States R1d ago
-
Data Engineer, Senior USD 77K-176KAWS | Agile | Azure | Azure Data | Azure Data FactoryDependent care | Paid leave | Paid training | Professional development | Retirement benefitsSenior-level Full TimeUSA, GA, Atlanta (575 Morosgo Drive … R1d ago
-
Data Engineer – Databricks USD 152K-200KAWS | Apache Airflow | Azure | Azure Data | Azure Data FactoryContract-to-hire | Hybrid work onsite 3 days per weekSenior-level Contract Full TimeBeaverton, OR, United States R1d ago
-
AI Integration Engineer USD 120K-155KAuthentication | Authentication tokens | Authorization | Automated testing | CI/CDSenior-level Full TimeSFI - Crystal City R1d ago
-
Senior Machine Learning Engineer, Economist USD 173K-218KCausal Inference | Cloud Computing | Contextual Bandits | Econometrics | Heterogeneous Treatment EffectFlex First work policy | In-person events | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Data Engineer USD 190K-240KAWS Bedrock | AWS Lambda | AWS S3 | AWS Secrets | AWS Secrets ManagerEquity upside | Optional retreats | Remote work | Work from anywhereSenior-level Full TimeRemote R2d ago
-
AI Developer USD 120K-155KAPI Development | API Integration | Agent Orchestration | Agile | Amazon BedrockOnsite hybrid work environment | W2 employmentMid-level Full TimeSFI - Crystal City R2d ago
-
Senior Data Infrastructure Engineer USD 202K-237KAWS Glue | Amazon Redshift | Apache Airflow | Apache Spark | CDCCareer development opportunities | Dental insurance | Flexible vacation policy | Health insurance | Hybrid workSenior-level Full TimeUS, Remote R2d ago
-
Senior Software Engineer – Full Stack (AI First) USD 174K-224KAPI Integration | AWS | Agile | Angular | AzureCareer development | Learning opportunities | Work from anywhereSenior-level Full TimePhoenix, Arizona R2d ago
-
Machine Learning Engineer II, Responsible AI USD 138K-285K2 Tower Models | Bias Mitigation | Ethics | Experimentation | FairnessMid-level Full TimeSan Francisco, CA, US; Remote, US R2d ago
-
Lead Data Engineer USD 174K-230KAirflow | BigQuery | DBT | Dagster | Data Modeling401k | Education/training stipend | Free OneMedical membership | HSA/FSA | Internet stipendSenior-level Full TimeRemote R2d ago
-
API Authentication | API authorization | CI Pipelines | CI/CD | Data ModelingMid-level Full TimeNew York, NY, United States R2d ago
-
Agile | Authentication | Authorization | CI/CD | Data ModelingMid-level Full TimeDallas, TX, United States R2d ago
-
Data Engineer II USD 78K-117KCI/CD | Cortex AI | Data Lake | Data Warehouse | ETL401k retirement plan | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level Full TimeBaltimore, Maryland, USA R2d ago
-
Data Engineer USD 101K-130KBI | DBT | Data Modeling | Data Monitoring | Data QualityHybrid work | On site 3 to 4 days per week | Self service analytics enablementMid-level Full TimeDallas, TX R2d ago
-
Data Engineer Snowflake/Agentic AI USD 110K-155KAWS CloudWatch | AWS RDS | AWS S3 | AWS Secrets | AWS Secrets ManagerHybrid work options | International mobility | Professional development | Remote work options | TrainingMid-level Full TimeUnited States - Remote R2d ago
-
Analytics Engineer USD 95K-105KBigQuery | Cursor | DBT | Data Contracts | Data Governance401k | Anniversary Milestone Celebrations | Flexible PTO | HSA contribution | Home internet reimbursementMid-level Full TimeRemote, United States R2d ago
-
Data Engineer (2258) USD 119K-150KAWS | Azure | Data Quality | Data Security | Data Visualization401k | Dependent care | Discounted tickets and entertainment | Flexible work schedule | Medical insuranceMid-level Full TimeNew York, New York, United States R2d ago
-
Staff Data Engineer USD 134K-175KAWS EMR | AWS Glue | AWS S3 | Agile | Apache Airflow401k matching | Dental insurance | Disability insurance | Employee assistance program | Employee referral programSenior-level Full TimeDenver, CO, USA R2d ago
-
Junior Data Engineer (Azure Databricks) USD 133K-150KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Big DataCertification programs | Health insurance | Internal mobility | Internship opportunities | Language coursesEntry-level Full TimeMadrid, MD, Spain R2d ago
-
Sr. Data Engineer (Hybrid - Addison, TX) USD 120K-150KAzure | Azure Data | Azure Data Factory | Data Cleansing | Data FactoryHybrid work schedule | Knowledge sharing culture | Onsite commute requirement 3 days per weekSenior-level Full TimeAddison, TX, United States R2d ago
-
Data Engineer II USD 150K-225KAmazon EKS | Amazon MSK | Amazon Web Services | Apache Flink | Apache Kafka401k match | Dental insurance | Employee discounts | Medical insurance | Paid time offMid-level Full TimeUnited States, Aliso Viejo, CA R2d ago