Data Engineer
Tasks
- Build data platforms
- Build dimensional models
- Collaborate with clients on requirements and architecture
- Design data platforms
- Develop data transformation workflows
- Engineer data solutions with Spark and SQL
- Implement data governance and lineage
- Implement lakehouse architectures
- Optimize batch and streaming ingestion pipelines
- Recommend data modeling best practices
- Set up monitoring and security best practices
Perks/Benefits
- Client-facing consulting
- Cross-functional collaboration
- Design sessions with stakeholders
- Leadership presentations
Skills/Tech-stack
AKS | Apache Spark | Automated testing | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Database | Azure Database for PostgreSQL | Azure Kubernetes | Azure Kubernetes Service | Azure SQL | Azure Synapse | Azure Synapse Analytics | Containers | Cosmos DB | Data Factory | Data Governance | Data Lineage | Data Sharing | Database for PostgreSQL | Databricks | Databricks Data Sharing | Databricks Unity | Databricks Unity Catalog | Delta Lake | DevOps | Dimensional Modeling | Docker | Git | GitHub | Kubernetes | Kubernetes Service | Medallion Lakehouse | Microsoft Azure | Microsoft Fabric | Monitoring | Mosaic AI | Orchestration | Power BI | PySpark | Python | SQL | Spark SQL | Synapse Analytics | Unity Catalog
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Applied LLM Systems Engineer USD 191K-253KAccess Management | Agent systems | Auditability | Caching | Cloud infrastructureSenior-level Full TimeCosta Mesa, California, United States12h ago
-
Staff Machine Learning Engineer USD 176K-308KAPI Design | Distributed Systems | Generative AI | Hybrid search | Inference Optimization401k plan with company match | ESPP | Family Leave Program | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R13h ago
-
Senior Analytics Engineer, Marketing Sciences USD 100K-125KAmazon Kinesis | DBT | Docker | JSON | Kafka401k match | Dental insurance | Employee resource groups | Flexible time off | Life and disability insuranceSenior-level Full TimeUnited States R13h ago
-
Sr Engineer, Data Engineering USD 30K-46KAmazon Web Services | Apache Spark | Azure | Data Lake | Data WarehouseSenior-level Full TimeRoswell, GA, United States15h ago
-
Machine Learning Engineer USD 161K-200KA/B | A/B Testing | B testing | Collaborative Filtering | Content-Based Filtering401k matching | Disability insurance | Fertility benefits | Health insurance | Life insuranceSenior-level Full TimeBellevue, WA R15h ago
-
AWS | Ansible | Automation | BAM | Bioinformatics401k match | Commuter benefits | Employee referral program | Fertility care benefits | Free employee genetic testingSenior-level Full TimeUS Remote R15h ago
-
Algorithm Engineer USD 150K-170KCI/CD | Deep learning | Digital Signal | Digital Signal Processing | DockerPTO | Remote workMid-level Full TimeBoston, MA / Remote R15h ago
-
Senior AI & Platforms Engineer USD 30K-84KAIOps | Asyncio | Autogen | CI/CD | CrewAIContract position | Local candidates required | Onsite work 3 days per weekSenior-level Contract Full TimeBrooklyn, NY, United States16h ago
-
Sr Analytics Engineer USD 125K-150KData Engineering | Data Modeling | Data analytics | Python | SQL401k program | Dental insurance | Disability insurance | Flexible spending accounts | Life insuranceSenior-level Full TimeChicago, IL17h ago
-
Senior-level Full TimeDetroit Area, Michigan17h ago
-
AI | API Integrations | Acceptance Testing | Application Support | Azure DevOpsMid-level Full TimeNYC, NY; Information Technology; New York, …18h ago
-
Senior-level Full TimeHerndon, VA; Information Technology; Tysons, VA; … R18h ago
-
Mid-level Full TimeHerndon, VA; Information Technology; Chantilly, VA; …18h ago
-
Software Developer/Systems Engineer USD 130K-170KAI | API Integration | Anomaly Detection | Data Classification | Data extractionTS SCI Clearance FSPMid-level Full TimeHerndon, VA; Information Technology; Annapolis Junction, …18h ago
-
Senior AI/ML Full Stack Engineer USD 130K-176KAWS | AWS Bedrock | Airflow | Authentication | AuthorizationFully remote | W2 onlySenior-level Full TimeRemote, MN; Information Technology R18h ago
-
CDC | Change Data Capture | Data Capture | Data Ingestion | Data Ingestion PipelinesContract 12 plus months | TeleworkMid-level Full TimeRemote, Texas; Information Technology R18h ago
-
Data Engineer - Vehicle Configuration Optimization USD 115K-192KData Governance | Data Modeling | Data Pipelines | Data Quality | DatabricksCompany Vehicle Lease Program | Dental insurance | Disability insurance | Family building benefit | Health insuranceMid-level Full TimeAuburn Hills, MI, United States18h ago
-
Accelerometer | C plus plus | Classification | Estimation Theory | Feature extractionMid-level Full TimeSanta Clara, California; Santa Clara, California18h ago
-
Agile | Algorithms | C# | C++ | Data StructuresSenior-level Full TimeSan Diego, California18h ago
-
Sr. AI Developer, Engineering USD 144K-189K.NET | APIs | Adobe Experience | Adobe Experience Cloud | Agent OrchestrationSenior-level Full TimeChicago, IL, United States19h ago
-
Senior Sales Engineer - NorthCentral USD 149K-198KAWS | Application Performance Monitoring | Application performance | Cloud Computing | Cloud platformBest in class onboarding | Continuous professional development | Employee stock purchase plan | Inclusive company culture | Mentor and buddy programSenior-level Full TimeIllinois, USA, Remote; Minnesota, USA, Remote R19h ago
-
MLOps Engineer USD 90K-120KAWS | AWS CDK | AWS CodeBuild | AWS CodePipeline | AWS Glue401k retirement plan | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractJuno Beach, Florida, USA R19h ago
-
Enterprise Sales Engineer - FED USD 118K-157KAmazon Web Services | Application Performance Monitoring | Application performance | Cloud platform | Developer experienceBest in class onboarding | Career pathing | Continuous professional development | Global benefits | Hybrid workplaceMid-level Full TimeDistrict of Columbia, USA, Remote; Maryland, … R19h ago
-
Senior Sales Engineer - FED USD 149K-198KAmazon Web Services | Application Performance Monitoring | Application performance | Cloud platform | CybersecurityEmployee stock purchase plan | Hybrid work | Mentor and buddy program | Onboarding program | Professional developmentSenior-level Full TimeDistrict of Columbia, USA, Remote; Maryland, … R19h ago
-
Forward Deployed AI Engineer (USA Based) USD 110K-160KAPIs | Agent Frameworks | Data Pipelines | Full Stack | Full-Stack DevelopmentEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeNew York, NY, United States20h ago