Principal Engineer I - Senior Data Engineer
USD 140K-180K (estimate) Senior-level Full Time
Tasks
- Apply test-driven development
- Build data lifecycle solutions
- Collaborate with stakeholders on requirements
- Design enterprise data platform components
- Develop ETL and data pipelines
- Implement Azure DevOps CI CD
- Implement data quality and compliance by design
- Lead data governance and enterprise architecture implementations
- Participate in data architecture decisions
- Perform data exploration and profiling
- Provide technical mentorship
- Tune and optimize Spark workloads
- Write PySpark ETL code
Perks/Benefits
- 401k matching
- Dental insurance
- Employee volunteer program
- Medical insurance
- Time off
- Tuition assistance
- Wellness program
Skills/Tech-stack
Agile | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Logic | Azure Logic Apps | Azure Synapse | Azure Synapse Analytics | Big Data | CI/CD | Data Catalog | Data Factory | Data Governance | Data Lake | Data Lake Storage | Data Lineage | Data Modeling | Data Quality | Data Warehousing | Databricks | ETL | Enterprise Architecture | Logic Apps | Microsoft Fabric | PL/SQL | PowerBI | PySpark | RDBMS | SAFe | SAS | Scrum | Spark SQL | Synapse Analytics | T-SQL | Tableau | Test-Driven | Test-Driven Development | Unstructured Data
Education
Related jobs
-
Senior Embedded Flight Software Engineer USD 160K-240KAMD Xilinx | AMD Xilinx FPGAs | AMD/Xilinx SoC | Agile | Aircraft systems401k | Casual dress code | Dental insurance | FSA | Free daily lunchSenior-level Full TimeHawthorne, CA6h ago
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Airflow | Amazon Redshift | Automated Labeling100% TelecommutingSenior-level Full TimeRedwood City, CA R8h ago
-
Principal Scientist, Machine Learning - Biomolecules USD 208K-286KAWS Batch | AWS ECS | AWS EKS | AWS S3 | AWS SageMakerAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeCambridge, MA USA8h ago
-
Mid-level Full TimeSan Francisco9h ago
-
Mid-level Full TimeSan Francisco9h ago
-
Data Engineer Data Pipelines and ETL USD 99K-147KAnomaly Detection | Apache Airflow | CDC | Cloud Composer | Data Governance401k plan | Disability benefits | Life insurance | Life insurance coverage | Medical/Dental/VisionMid-level Full TimeBurbank, CA, US, 9150510h ago
-
Sr. Software Engineer, Data Streaming Systems USD 130K-195KAutoscaling | Blocking I/O | CI/CD | Concurrency | Distributed Systems401k plan | Dental insurance | Disability benefits | Life insurance | Medical insuranceSenior-level Full TimeBurbank, CA, US, 9150510h ago
-
Senior Analytics Engineer, GTM USD 176K-265KAPI Integration | CI/CD | DBT | Data Modeling | Data QualityCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeSanta Clara, California10h ago
-
Machine Learning Engineer USD 140K-190KApache Flink | Apache Kafka | Apache Spark | Bigtable | CI/CDMid-level Full TimeRemote - USA R11h ago
-
Senior Embedded Software Engineer - Future Forward USD 153K-201KAgile | Authentication | Board Bring-up | Bring-up | C#Senior-level Full TimeSunnyvale, CA, United States R12h ago
-
Embedded Device Firmware Engineer USD 145K-195KAutomated testing | C# | C++ | CI/CD | Circuit debuggingMid-level Full TimeSanta Clara, CA12h ago
-
Embedded Software Engineer II USD 140K-200KBootloader | C# | C++ | CI/CD | Device DriversDental insurance | Disability insurance | FSA | HSA | Health insuranceSenior-level Full TimeEl Segundo, CA13h ago
-
Senior Software Engineer - Data Platform USD 130K-220KAWS Lambda | AWS RDS | Airflow | Amundsen | Apache HiveHealth insurance | Parental leave | Professional development stipend | Remote workSenior-level Full TimeRemote - US R13h ago
-
Embedded Software Engineer II USD 140K-200KBootloader | C# | C++ | CI/CD | Device Driver DevelopmentDental insurance | Health insurance | Retirement plan | Stock options | Vision insuranceSenior-level Full TimeAustin, TX13h ago
-
Embedded Software Engineer II USD 140K-200KC# | C++ | CI/CD | Device Drivers | Embedded LinuxDental insurance | Disability insurance | FSA | HSA | Health insuranceSenior-level Full TimeWestminster, CO13h ago
-
Data Engineer, Palo Alto USD 110K-180KAWS | Data Modeling | Data Pipelines | DynamoDB | ETL401k matching | Dental insurance | Flexible spending accounts | Health insurance | HolidaysMid-level Full TimePalo Alto, California, United States13h ago
-
Robotics Systems Software Engineer USD 141K-224KAlgorithms | C++ | CI/CD | Collision detection | Computer VisionCompany holidays | Health insurance | Learning and development reimbursement | Life insurance | Long-term disabilityMid-level Full TimeTorrance, California, United States14h ago
-
Industrial Robotics Engineer USD 141K-224KAlgorithms | C++ | CI/CD | Collision detection | Computer VisionCompany holidays | Health insurance | Hybrid work | Learning and development reimbursement | Life insuranceMid-level Full TimeTorrance, California, United States14h ago
-
Principal Architect (Data Architecture) USD 100K-150KAWS Glue | Amazon Redshift | Apache NiFi | Architecture Principles | Azure Data401k retirement plan | Dental insurance | Disability coverage | Flexible spending account | Health insuranceSenior-level Full TimeRemote, United States R14h ago
-
Ai Engineer USD 100K-150KAI Agents | API Development | AWS | AWS Bedrock | Agentic Workflows401k | Commuter benefits | Dental insurance | Disability coverage | EAPMid-level Full TimeColumbia, MD, United States14h ago
-
Senior-level Contract Full TimeReston, VA, United States15h ago
-
Senior Machine Learning Engineer USD 141K-250KApache Spark | C++ | Data Preprocessing | Deep Neural Networks | Deep learning401k matching | Dental insurance | Flexible spending accounts | Health insurance | Mental health programSenior-level Full TimePalo Alto, California, United States15h ago
-
Senior AI/ML Engineer: Python & Scientific Computing USD 175K-250KCelery | Distributed Computing | Flask | GraphQL | High PerformanceSenior-level Full TimeSan Francisco15h ago
-
Software Engineer, Platform USD 216K-270KAWS | Amazon Step Functions | Authentication | Authorization | CI/CDCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA; New York, NY15h ago
-
Data Engineer- Hybrid Onsite Des Moines, Iowa USD 87K-123KApache Spark | Azure Databricks | Azure DevOps | Bash | Data Mapping401k match | Health insurance | Hybrid work | Lifestyle spending account | LinkedIn Learning accessMid-level Full TimeDes Moines, Iowa, United States R16h ago