Staff Engineer II - Data Engineer
Tasks
- Apply test-driven development
- Design and implement reliability and recovery procedures
- Design build and support ETL pipelines
- Design performance monitoring metrics
- Develop and maintain technical documentation
- Develop reusable PySpark components
- Implement Azure DevOps CI CD
- Implement data governance and data quality standards
- Lead technical solution design planning
- Optimize data processing patterns
- Provide technical guidance to stakeholders
Perks/Benefits
- 401k matching
- Dental insurance
- Employee volunteer program
- Medical insurance
- Time off
- Tuition assistance
- Wellness program
Skills/Tech-stack
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOps | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Architecture | Data Catalog | Data Factory | Data Governance | Data Lake | Data Lineage | Data Quality | Data Warehousing | Databricks | ETL | Enterprise Data | Enterprise Data Architecture | Microsoft Fabric | PL/SQL | PySpark | SAFe | SQL | Scrum | Spark SQL | Synapse Analytics | T-SQL | Test-Driven | Test-Driven Development
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R3d ago
-
AI | Adversarial Machine Learning | Bot Detection | Data Analysis | Data IntegrityMid-level Full TimeMountain View, CA, USA4h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R11h ago
-
Senior-level Full TimeMountain View, CA13h ago
-
Staff Software Engineer, AI Integrations USD 170K-240KAgile | Alerting | Amazon Web Services | C++ | CSSSenior-level Full TimeMountain View, CA13h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-204KAPI Testing | Cypher | Data Processing | DataOps | DevOpsCompetitive benefits | Growth opportunity | Remote work | TravelSenior-level Full TimeReston, VA, United States R23h ago
-
AWS | AWS CloudFormation | Amazon ECS | Automation | CI/CD401-k plan | Company match | Employee stock purchase plan | Healthcare benefits | Life insuranceMid-level Full TimeAtlanta, GA, United States1d ago
-
Machine Learning Engineer USD 124K-170KAWS Bedrock | AWS Fargate | AWS Lambda | AWS Step Functions | Amazon ECSCareer development opportunities | Equal employment opportunityMid-level Full TimePlano, Texas, United States1d ago
-
Machine Learning Engineer USD 117K-177KAWS | Azure | Cloud Computing | Data Visualization | Google CloudMid-level Full TimeSt. Louis, Missouri, United States1d ago
-
Software Engineer - X Data USD 125K-400KApache Flink | Apache Kafka | Apache Spark | BigQuery | Cause analysis401k retirement plan | Dental insurance | Discounts | Health insurance | Life insuranceMid-level Full TimePalo Alto, CA1d ago
-
Applied AI Engineer USD 204K-352KBackend Development | Cloud infrastructure | Deep learning | Docker | Fine TuningAnnual membership | Centralized coffee stipend | Flexible PTO | Health and wellness stipend | Health, dental, and vision insuranceSenior-level Full TimeNew York, NY (HQ)1d ago
-
Staff AI Engineer USD 140K-210KAPI Development | AWS | Access Management | Bedrock AgentCore | CI/CD401k | All-hands meetings | Dental insurance | Employee equity program | Health insuranceSenior-level Full TimeNew York City1d ago
-
Senior Quantum Embedded Engineer USD 142K-175K10G Ethernet | AMD Xilinx | AMD Xilinx toolchain | AMD/Xilinx SoC | BashHybrid work options | Remote work optionsSenior-level Full TimeNew Haven, CT1d ago
-
Senior AI Engineer USD 125K-145KAPI Management | AWS | Azure | Azure DevOps | C#401k plan | Career advancement | Dental insurance | Dependent care | Flexible spending accountSenior-level Full TimeCleveland, OH, United States1d ago
-
Senior Data Solutions Lead USD 175K-200KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkDHS Public Trust suitability determination | Remote workSenior-level Full TimeWork from home, VA, United States R1d ago
-
Senior Analyst, Business Strategy and Analytics USD 95K-135KData Governance | Data Integrity | Data Mining | Data Validation | Microsoft Access401k match | Education assistance | Employee discounts | Family & fertility benefits | Free virtual health careSenior-level Full TimeColumbus, OH, United States1d ago
-
Big Data Engineer / Sr. Level - GCP USD 88K-174KAPI Development | API Versioning | Apigee | Avro | Big DataContract-to-hireSenior-level Full TimeNashville, TN, United States2d ago
-
Senior Python AI/ML Developer USD 140K-170KAsynchronous programming | CI/CD | Django | DynamoDB | FastAPISenior-level Full TimeUS-NJ-Jersey City2d ago
-
Mid-level Full TimeUS-NJ-Jersey City2d ago
-
C plus plus | CI/CD | Cloud Computing | Computer Vision | Deep learningSenior-level Full TimeBurlingame, CA2d ago
-
Senior Staff Software Engineer, Knowledge Catalog For AI USD 262K-365KBig Data | C++ | Computer Vision | Data Governance | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA2d ago
-
Principal Data Engineer USD 180K-220KAWS | Apache Airflow | Artificial Intelligence | CI/CD | Confluence401k | Autonomy | Company paid life insurance | Disability coverage | FSASenior-level Full TimeRemote - US, Canada and Poland R2d ago
-
Senior Data Engineer, Public Sector USD 150K-259KBusiness Intelligence | DBT | Data Mart | Data Modeling | Data PipelinesCommuter stipend | Generous PTO | Health, dental and vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeWashington, DC2d ago
-
Data Engineer USD 132K-165KAWS | Azure | Cassandra | Data Governance | Data Lakes401k match | Dental insurance | Employee assistance program | Life insurance | Medical insuranceSenior-level Full TimePlano, TX, US2d ago
-
Data Platform Engineer, Infrastructure USD 70K-300KAWS | Alerting | Audit Logging | CI/CD | Capacity PlanningFlexible hours | Onsite work | Work-life balanceMid-level Full TimeIrvine, CA2d ago