Staff Engineer II - Data Engineer
Tasks
- Apply test-driven development
- Design and implement reliability and recovery procedures
- Design build and support ETL pipelines
- Design performance monitoring metrics
- Develop and maintain technical documentation
- Develop reusable PySpark components
- Implement Azure DevOps CI CD
- Implement data governance and data quality standards
- Lead technical solution design planning
- Optimize data processing patterns
- Provide technical guidance to stakeholders
Perks/Benefits
- 401k matching
- Dental insurance
- Employee volunteer program
- Medical insurance
- Time off
- Tuition assistance
- Wellness program
Skills/Tech-stack
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOps | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Architecture | Data Catalog | Data Factory | Data Governance | Data Lake | Data Lineage | Data Quality | Data Warehousing | Databricks | ETL | Enterprise Data | Enterprise Data Architecture | Microsoft Fabric | PL/SQL | PySpark | SAFe | SQL | Scrum | Spark SQL | Synapse Analytics | T-SQL | Test-Driven | Test-Driven Development
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS Step Functions100 percent on siteSenior-level ContractMc Lean, United States6h ago
-
AI | Adversarial Machine Learning | Bot Detection | Data Analysis | Data IntegrityMid-level Full TimeMountain View, CA, USA8h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R15h ago
-
Senior-level Full TimeMountain View, CA17h ago
-
Staff Software Engineer, AI Integrations USD 170K-240KAgile | Alerting | Amazon Web Services | C++ | CSSSenior-level Full TimeMountain View, CA17h ago
-
Principal / Sr Principal Data Analytics Engineer USD 98K-184KAgile | CI/CD | Data Governance | Data Modeling | Data MonitoringCompany-Paid Holidays | Disability insurance | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeFLME229, United States20h ago
-
Sr. Data Engineer USD 109K-145KAWS | Agile | CI/CD | Compliance | Data Governance401k matching | Employee assistance program | Flexible working hours | Learning platform access | Medical, dental, and vision insuranceSenior-level Full TimeRemote, TX, United States R20h ago
-
Senior Machine Learning Engineer USD 134K-168KData Drift | Databricks | Ethical AI | Feature Engineering | KubernetesSenior-level Full TimeNew York, NY, United States20h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-204KAPI Testing | Cypher | Data Processing | DataOps | DevOpsCompetitive benefits | Growth opportunity | Remote work | TravelSenior-level Full TimeReston, VA, United States R1d ago
-
AWS | AWS CloudFormation | Amazon ECS | Automation | CI/CD401-k plan | Company match | Employee stock purchase plan | Healthcare benefits | Life insuranceMid-level Full TimeAtlanta, GA, United States1d ago
-
Associate Software Engineer (Python + AWS) USD 143K-194KAWS Lambda | AWS S3 | AWS SNS | AWS SQS | Amazon Web ServicesHybrid work | Work authorization not requiring visa sponsorship | Work from home up to three days per weekMid-level Full TimeBaltimore, Maryland, United States1d ago
-
Machine Learning Engineer USD 124K-170KAWS Bedrock | AWS Fargate | AWS Lambda | AWS Step Functions | Amazon ECSCareer development opportunities | Equal employment opportunityMid-level Full TimePlano, Texas, United States1d ago
-
Machine Learning Engineer USD 117K-177KAWS | Azure | Cloud Computing | Data Visualization | Google CloudMid-level Full TimeSt. Louis, Missouri, United States1d ago
-
Sr. Database Engineer (MongoDB) USD 127K-236KAWS | Agile | Confluence | Django | Docker401k contribution | Career development | Dental insurance | Health insurance | Holiday paySenior-level Full TimeLinthicum Heights, MD1d ago
-
Database Engineer (MongoDB) USD 100K-176KAWS | Agile | Confluence | Django | Docker401k match | Career development | Dental insurance | Health insurance | Paid HolidaysMid-level Full TimeLinthicum Heights, MD1d ago
-
Systems Engineer (Computer Network Support - AI/ML) USD 146K-206KAI/ML | Agile | Confluence | Jira | Process Engineering401k match | Career counseling and training | Health, dental, vision coverage | Paid Holidays | Paid time offMid-level Full TimeFort Meade, MD1d ago
-
Database Engineer (Oracle) USD 131K-220KDatabase Administration | Database Connectivity | Database Design | Database optimization | Open DatabaseCareer development | Dental insurance | Employee referral bonus | Health insurance | Holiday paySenior-level Full TimeFort Meade, MD1d ago
-
Software Engineer - X Data USD 125K-400KApache Flink | Apache Kafka | Apache Spark | BigQuery | Cause analysis401k retirement plan | Dental insurance | Discounts | Health insurance | Life insuranceMid-level Full TimePalo Alto, CA1d ago
-
Applied AI Engineer USD 204K-352KBackend Development | Cloud infrastructure | Deep learning | Docker | Fine TuningAnnual membership | Centralized coffee stipend | Flexible PTO | Health and wellness stipend | Health, dental, and vision insuranceSenior-level Full TimeNew York, NY (HQ)1d ago
-
Staff AI Engineer USD 140K-210KAPI Development | AWS | Access Management | Bedrock AgentCore | CI/CD401k | All-hands meetings | Dental insurance | Employee equity program | Health insuranceSenior-level Full TimeNew York City1d ago
-
Senior Quantum Embedded Engineer USD 142K-175K10G Ethernet | AMD Xilinx | AMD Xilinx toolchain | AMD/Xilinx SoC | BashHybrid work options | Remote work optionsSenior-level Full TimeNew Haven, CT1d ago
-
Senior AI Engineer USD 125K-145KAPI Management | AWS | Azure | Azure DevOps | C#401k plan | Career advancement | Dental insurance | Dependent care | Flexible spending accountSenior-level Full TimeCleveland, OH, United States1d ago
-
Senior Data Solutions Lead USD 175K-200KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkDHS Public Trust suitability determination | Remote workSenior-level Full TimeWork from home, VA, United States R2d ago
-
Senior Analyst, Business Strategy and Analytics USD 95K-135KData Governance | Data Integrity | Data Mining | Data Validation | Microsoft Access401k match | Education assistance | Employee discounts | Family & fertility benefits | Free virtual health careSenior-level Full TimeColumbus, OH, United States2d ago