Sr Data Engineer, Data Analytics & Intelligence, NA
Tasks
- Apply data governance and access control
- Build batch and incremental ingestion pipelines
- Conduct code reviews and sprint planning
- Create semantic model inputs
- Design scalable data pipelines
- Develop curated lakehouse datasets
- Document business rules and data lineage
- Identify and route data quality issues
- Implement SQL and Spark transformations
- Maintain observability and auditability
- Monitor and troubleshoot data pipelines
- Optimize Spark job and SQL query performance
- Prepare datasets for AI agent use cases
- Update pipeline and dataset documentation
Perks/Benefits
- Flexible work policy
- Health and wellness benefits
- On-site work schedule
- Professional development support
- Travel opportunities
Skills/Tech-stack
Agile | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Synapse | CI/CD | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Modeling | Data Quality | Dimension tables | ELT | ETL | Fact tables | Git | GitHub | Incremental processing | Jira | Lakehouse | Metadata | Microsoft Fabric | PySpark | Python | SQL | Semantic Modeling
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Data Analytics
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Data Engineer USD 110K-165KCause analysis | Data Analysis | Data Pipelines | Data Processing | Data TransformationSenior-level Full TimeFAIRFAX, VA, United States5h ago
-
Lead Data Engineer USD 114K-160KBusiness Objects | Business Process | Business Process Redesign | Case Development | Compliance AuditingSenior-level Full TimeColumbus, GA, United States6h ago
-
Azure Data -AI -Architect USD 119K-258KAzure Compliance | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsSenior-level Full TimeUSA7h ago
-
Mid-level Full TimeNew York, NY, US8h ago
-
Senior-level Full TimeJersey City, NJ, United States9h ago
-
Applied AI/ML [Multiple Positions Available] USD 165K-195KAI Governance | AI governance framework | AWS | Azure | BM25Backup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States9h ago
-
AWS | AWS EMR | AWS Glue | Amazon S3 | Apache AirflowSenior-level Full TimePrinceton10h ago
-
Alerting | Data Governance | Data Modeling | Data Quality | Data Versioning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton10h ago
-
Principal Software Engineer USD 105K-159KAWS | Agile | Azure | Bitbucket | CI/CDFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesSenior-level Full TimeTampa, FL, United States R10h ago
-
Sr. Robotics Engineer USD 124K-186KAgile | Bash | Build Servers | C# | C++401k | Adoption Assistance | Charitable contribution match | Defined contribution plan | Discount programsSenior-level Full TimeSanta Clara,California,United States10h ago
-
Senior Software Engineer, Infrastructure, Google Cloud USD 174K-253KApache Beam | Apache Spark | C++ | Compute architecture | Data AnalysisSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Software Engineer, Machine Learning, Travel Ads USD 147K-211KA/B | A/B Testing | Adbrain | B testing | C++Mid-level Full TimeMountain View, CA, USA11h ago
-
Cloud Technical Solutions Engineer, Storage and Database USD 150K-218KC# | C++ | Docker | HTTP | Java24x7 support coverageSenior-level Full TimeSunnyvale, CA, USA; Austin, TX, USA11h ago
-
Software Engineer III, Cloud Bigtable SQL and Analytics USD 147K-211KApproximate Nearest Neighbors | Beam | C++ | Concurrency | Consistency modelsSenior-level Full TimeNew York, NY, USA11h ago
-
Algorithms | C++ | Cloud Storage | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Research Engineer, Humanoids, DeepMind USD 147K-211KC++ | Debugging | Foundation Models | JAX | Language ProcessingMid-level Full TimeMountain View, CA, USA11h ago
-
Airflow | Apache Beam | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeMountain View, CA, USA; New York, …11h ago
-
Senior Staff Engineer, GDC AI Inference Platform USD 262K-365KAgent coordination | C++ | Cloud infrastructure | Containerization | Data StructuresBonus | Equity | Health insurance | Paid time off | Retirement plansSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA11h ago
-
Business Intelligence - Data Engineer 133-2015 USD 80K-115KData Transformation | Data analytics | Data pipeline | Dependency management | ETLMid-level Full TimeTulsa, OK, US14h ago
-
Sr AI Engineer USD 115K-142KAgent systems | Agentic Workflows | CI/CD | Citation Grounding | Cloud ComputingSenior-level Full TimeAda, MI, United States, 4935515h ago
-
PIIM Analytics Engineer USD 86K-132KAPIs | Access Control | Azure Databricks | Data Architecture | Data GovernanceDental insurance | Medical insurance | Optional Disability Insurance | Paid time off | Supplemental insuranceMid-level Full TimeClay, NY, US17h ago
-
PIIM Analytics Engineer USD 105K-160KAI/ML | APIs | Access Control | Azure Databricks | Code AutomationFull time office or project telework | Relocation assistanceMid-level Full TimeHouston, TX, US17h ago
-
Senior-level Full TimeSeattle, Washington, United States; USA - …18h ago
-
Principal AI Engineering Architect USD 224K-308KAWS | Data Processing | Docker | Google Cloud | High AvailabilityAdoption and surrogacy reimbursement | Cancer Care Program | Employee Assistance Program (EAP) | Fertility coverage | Flexible time offSenior-level Full TimeUnited States - Remote R18h ago