Engineer IV, Data Engineering
Pittsburgh, PA, United States
USD 160K-193K (estimate) Senior-level Full Time
Tasks
- Create data pipeline designs
- Define coding standards and testing practices
- Develop metadata driven pipeline patterns
- Ensure production readiness
- Evaluate and operationalize new technologies
- Implement automated data quality checks
- Lead implementation and mentor engineers
- Maintain reliability and recovery SLAs
- Provide production support and optimize jobs
- Resolve complex production issues with root cause fixes
- Translate business needs into engineering designs
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Apache Spark | CI/CD | Configuration Driven Pipelines | Data Governance | Data Lineage | Data Observability | Data Quality | Databricks | Databricks Delta | Databricks Delta Live Tables | Delta Lake | Delta Live Tables | Error Handling | Great Expectations | Metadata Driven | Metadata driven pipelines | Monitoring | Orchestration | Partitioning | PySpark | Python | SQL | Schema evolution | Spark Structured Streaming | Structured Streaming | Unity Catalog
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Data Engineer IV | Data Engineering | Engineer IV | Engineering
Regions
Countries
States
Cities
Related jobs
-
Mid-level Full TimeBurlingame, CA2h ago
-
Data Engineer, Analytics USD 209K-235KData Warehousing | Dimensional Modeling | ETL | MPP | MapReduceEntry-level Full TimeBurlingame, CA2h ago
-
Senior Data Engineer - Remote USD 150K-160KAPIs | Data Governance | Data Lineage | Data Management | Data Modeling401k | Dental insurance | Health and wellness programs | Health insurance | Life insuranceSenior-level Full TimeAtlanta, GA, US, 30328 R6h ago
-
Data Engineer I USD 68K-100KAPI Keys | Azure | Azure Data | Azure Data Factory | Azure Synapse401k match | Employee onboarding program | Flexible PTO | Health and wellness benefits | Onsite optionsEntry-level Full TimeMorrisville, NC, US, 275606h ago
-
Senior-level Full TimeTampa, FL10h ago
-
Principal Data Engineer - Central Product Insights USD 178K-249KAWS | Apache Airflow | Apache Spark | Cloud platform | DBT401k match | Dental insurance | Flexible work schedule | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA13h ago
-
Machine Learning Engineer USD 90K-167KData Modeling | Data Pipelines | Data Querying | Data Transformation | Data VisualizationDental insurance | Health insurance | Hybrid work environment | Mentorship | Paid time offMid-level Full TimeUSA, Massachusetts, Boston, 200 Berkeley Street, …13h ago
-
Solutions Architect/Data Engineer USD 145K-175KAWS | AWS IAM | AWS Lambda | Amazon EC2 | Amazon RDS401k matching | Dental insurance | Employee development program | Employee referral program | Medical insuranceSenior-level Full TimeRemote, MD, US R13h ago
-
Apache Spark | Data Modeling | Data Quality | Data pipeline | LoggingEmployee travel credits | Remote work eligibilitySenior-level Full TimeUnited States14h ago
-
Sr. Engineering Manager, MLOps USD 270K-300KAWS | Amazon SageMaker | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimePalo Alto, California, United States14h ago
-
Senior Data Engineer USD 120K-126K3NF | API Design | API Management | API Versioning | APIM401k match | Charitable Gift Matching | Dental insurance | Discounted personal insurance | Employee stock ownership planSenior-level Full TimeWestern States or Midwest14h ago
-
APIs | Amazon S3 | Batch scheduling | Cloud Storage | Configuration ManagementEntry-level InternshipPalo Alto, California, United States; Remote R15h ago
-
Head of AI Data (STEM) USD 350K-410KAI Feedback | Data Quality | Data Synthesis | Data evaluation | Data labeling5 days a week | Collaborative culture | Competitive compensation | Flexible working hours | Supportive work environmentExecutive-level Full TimeSan Francisco, California, United States15h ago
-
Data Engineer, Consumer USD 160K-225KAmazon Web Services | Apache Airflow | Cloud Databases | Cloud Workflows | Cloud platformSenior-level Full TimeChicago, IL; Redwood City, CA15h ago
-
Data Engineer USD 115K-135KAPIs | Anomaly Detection | CDC | CI/CD | Cause analysis401k matching | Dental insurance | Health insurance | Paid Maternity Leave | Paid time offSenior-level Full TimeChicago, Illinois, United States15h ago
-
Staff Data Engineer, Search and Discovery USD 142K-309KAirflow | Amazon S3 | DBT | Dagster | Distributed Systems401k plan | Dental insurance | Employee assistance program | Flexible spending account | Health insuranceSenior-level Full TimeMountain View, USA15h ago
-
Senior Data/ML Engineer USD 151K-205KDBT | Data Architecture | Data Governance | Data Observability | Data Quality401k match | Dental insurance | Equity | Family planning resources | Flexible vacation policySenior-level Full TimeRemote - USA R16h ago
-
AI workflows | ARM Templates | AWS | Access Management | Apache SparkSenior-level Full TimeNew York, NY, US; Mountain View, …16h ago
-
Senior Data Engineer USD 200K-220KAirflow | Apache Beam | BigQuery | C# | C++401k match | Cell phone stipend | Commuter benefits | Employer HSA contributions | Health, dental, vision insuranceSenior-level Full TimeSan Francisco, CA - US16h ago
-
Staff Analytics Engineer USD 183K-225KAnomaly Detection | DBT | Dashboards | Data Governance | Data Lineage401k match | Dental insurance | Equity | Family planning resources | Flexible vacationSenior-level Full TimeRemote - USA R16h ago
-
Mid-level Full TimeUnited States17h ago
-
Senior Data Engineer USD 114K-140KAgile Scrum | Ataccama ONE | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePomona, California, United States17h ago
-
Data Engineer USD 107K-178KAirflow | Amazon Redshift | Apache Kafka | Azure Synapse | Azure Synapse AnalyticsChild care benefits | Dental insurance | Employee resource groups | Flexible family care days | Health insuranceMid-level Full TimeDearborn, MI, United States18h ago
-
Data Engineering (Onsite - San Antonio, TX) USD 100K-203KAI Engineering | AWS | Alerting | Automated Monitoring | Data QualitySenior-level Full TimeSan Antonio, TX19h ago
-
Technical Lead Manager, Eval Data Platform USD 251K-310KC++ | Cloud infrastructure | Data Modeling | Data Processing | Distributed SystemsBonus program | Company benefits program | Equity incentive plan | Hybrid workSenior-level Full TimeMountain View, CA, USA; New York, …19h ago