Sr Data Engineer, Data Analytics & Intelligence, NA
Tasks
- Apply data governance and access control
- Build batch and incremental ingestion pipelines
- Conduct code reviews and sprint planning
- Create semantic model inputs
- Design scalable data pipelines
- Develop curated lakehouse datasets
- Document business rules and data lineage
- Identify and route data quality issues
- Implement SQL and Spark transformations
- Maintain observability and auditability
- Monitor and troubleshoot data pipelines
- Optimize Spark job and SQL query performance
- Prepare datasets for AI agent use cases
- Update pipeline and dataset documentation
Perks/Benefits
- Flexible work policy
- Health and wellness benefits
- On-site work schedule
- Professional development support
- Travel opportunities
Skills/Tech-stack
Agile | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Synapse | CI/CD | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Modeling | Data Quality | Dimension tables | ELT | ETL | Fact tables | Git | GitHub | Incremental processing | Jira | Lakehouse | Metadata | Microsoft Fabric | PySpark | Python | SQL | Semantic Modeling
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Data Analytics
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Data Engineer III USD 97K-163KApache Spark | Data Modeling | Data Quality | Data integration | DatabricksAbility to work independently | Mentorship | Professional development | Travel opportunitiesSenior-level Full TimeBaltimore, Maryland, United States2h ago
-
Senior-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …2h ago
-
Senior-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …2h ago
-
Security Engineer, Investigator - GenAI USD 143K-208KAI detection | Agent Orchestration | Bias Mitigation | Big Data | Cyber ThreatsMid-level Full TimeMenlo Park, CA | Seattle, WA …4h ago
-
ABAQUS | ANSYS | Bearings | Bolted Joints | CADSenior-level Full TimeRedmond, WA4h ago
-
Software Engineer, AI/ML, Google Lens USD 147K-210KA/B | A/B Testing | API Design | Accessibility | B testingMid-level Full TimeMountain View, CA, USA4h ago
-
PIIM Data Engineer USD 105K-160KAPIs | Azure Databricks | Data Governance | Data Lake | Data ModelingCareer growth | Relocation assistance | Time to rechargeMid-level Full TimeNew Albany, OH, US10h ago
-
Senior/Staff Data Scientist USD 184K-200KConvolutional Neural Networks | Data Preprocessing | Data cleaning | Deep learning | Evaluation metrics401k match | Cell phone stipend | Company Wellness Days | Dental insurance | Employee stock purchase planSenior-level Full TimeSunnyvale, CA11h ago
-
Design Reliability Engineer (Falcon & Dragon) USD 115K-160KABAQUS | ANSYS | Automation | Composite layup | Data Analysis401k retirement plan | Dental coverage | Employee stock purchase plan | Medical coverage | Paid HolidaysEntry-level Full TimeHawthorne, CA11h ago
-
Software Engineer, Embedded UI USD 170K-210KAI Agents | API Design | Automation | BrightScript | C++Disability benefits | Equity awards | Financial wellness support | Flexible work schedule | Health insuranceSenior-level Full TimeSan Jose, California11h ago
-
AI Search | Application Insights | Azure AI | Azure AI Search | Azure Container401k | Commuter benefits | Dental insurance | Educational assistance | Health savings accountMid-level Full TimeNew York, United States R12h ago
-
Robotics AI Engineer - Sensor Calibration USD 70K-300K3D Geometry | C++ | Camera Calibration | Ceres-Solver | Computer VisionSenior-level Full TimeIrvine, CA12h ago
-
Staff Machine Learning Engineer - Ads USD 164K-282KAirflow | Apache Spark | BigQuery | Cloud Computing | Deep learning401k plan with company match | Flexible spending accounts | Health savings account | Medical/dental/vision/life insurance | Paid parental leaveSenior-level Full TimeMountain View, USA13h ago
-
Staff Machine Learning Engineer - Ads USD 164K-282KAirflow | Amazon SageMaker | Apache Spark | BigQuery | Contrastive Learning401k plan with company match | Electric Car Charging Station | Employee assistance program | Flexible spending accounts | Health savings accountSenior-level Full TimeMountain View, USA13h ago
-
Senior Data Engineer USD 135K-160KAWS | Airflow | Backfills | CI/CD | Data Modeling401k | Central time zone | Dental insurance | Employer Paid Long-term Disability | Employer Paid Short-term DisabilitySenior-level Full TimeChicago, IL, US R14h ago
-
AI Infrastructure Engineer – Agents & ML Systems USD 175K-200KAirflow | Amazon S3 | Backend Development | C++ | Dagster401k matching | Equity package | Global Entry | Health and wellness stipend | Health, dental, vision insuranceMid-level Full TimeRemote R14h ago
-
Senior Data Engineer USD 60K-76KAWS Glue | AWS Lambda | AWS S3 | AWS Secrets | AWS Secrets ManagerLearning and development resourcesSenior-level Full TimeNew York, US15h ago
-
C++ | Causal reasoning | Deep learning | Foundation Models | Generative ModelsMid-level Full TimeMountain View, CA USA; San Francisco, …16h ago
-
Senior-level Full TimeNew York, NY - Hybrid (3x … R17h ago
-
Senior-level Full TimeDallas, TX - Hybrid (3x in … R17h ago
-
Senior-level Full TimeMcLean, VA; McLean, VIRGINIA; McLean, VIRGINIA; …17h ago
-
Senior-level Full TimeMcLean, VIRGINIA17h ago
-
Data Engineer (Expert) WA07 USD 133K-238KData Mapping | Data Modeling | Data Quality | Data Testing | ETLSenior-level Full TimeChantilly, Virginia17h ago
-
Data Engineer (Subject Matter Expert) WA28 USD 133K-238KApache NiFi | CSS | Data Modeling | Data Quality | ETLSenior-level Full TimeChantilly, VA17h ago