Sr Data Engineer
Mc Lean, United States
A USD 156K-192K (estimate) Senior-level Contract
Tasks
- Build and manage Snowflake warehouses schemas and data models
- Build production data transformation pipelines
- Collaborate with architects business analysts and program managers
- Create incremental processing using Snowflake dynamic tables and materialized views
- Design Apache Iceberg tables in Snowflake
- Design scalable batch and streaming data pipelines
- Document technical designs data schemas and runbooks
- Implement data validation lineage tracking and monitoring
- Implement deduplication strategies
- Migrate legacy ETL workloads to PySpark and Snowflake
- Monitor and optimize Spark Snowflake and AWS costs
- Optimize Snowflake workloads using clustering and partition pruning
- Tune distributed Spark jobs for performance
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS Step Functions | Airflow | Amazon CloudWatch | Amazon EMR | Amazon Redshift | Amazon S3 | Apache Iceberg | Apache Kafka | Apache Spark | Broadcast joins | CTE | Caching | Clustering keys | Continuous Deployment | Continuous integration | DBT | Data Lakes | Data Lineage | Data Monitoring | Data Validation | Delta Lake | Dynamic Tables | ELT | ETL | ETL migration | Git | GitHub Actions | Great Expectations | Jenkins | Lakehouse | Materialized views | Parquet | Partitioning | PySpark | Python | Query profiling | RBAC | Result Caching | SQL | Shuffle Optimization | SnowSQL | Snowflake | Snowflake Streams | Snowflake Tasks | Snowpipe | Step Functions | Terraform | Window Functions
Education
N/A
Roles
Related jobs
-
AI/Machine Learning Engineer USD 99K-225KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k Company Contributions | Career development | Company funded HRA | Employer-paid life insurance | Long-term disabilityMid-level Full TimeFt. Meade, MD; Laurel, MD R15h ago
-
AWS Bedrock | CI/CD | CUI | Chunking | Data GovernanceGovernment furnished equipment | Mentorship | Remote work | US clearance support for CUI SPI environmentsEntry-level Full TimeMenlo Park, CA, United States16h ago
-
Lead Software Engineer - Python/PySpark/AWS/Databricks USD 170K-189KAWS | Automated testing | Cause analysis | Cloud Architecture | Data EngineeringBackup childcare | Financial coaching | Health and wellness centers | Health care coverage | Mental health supportSenior-level Full TimeWilmington, DE, United States17h ago
-
Data Engineer USD 114K-190KData Modeling | Data Pipelines | Data Transformation | ETL | JavaScriptDependent life insurance | Disability insurance | Health insurance | Holiday pay | Learning and developmentSenior-level Full TimeUSA-VA-Herndon17h ago
-
Senior QuickSight Analytics Engineer USD 107K-179KAmazon QuickSight | Data Modeling | Data Pipelines | Data Quality | Data TransformationMentorship | Professional development | Travel 10 percentSenior-level Full TimeBaltimore, Maryland, United States; Rosslyn, Virginia, …18h ago
-
AWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatch | Apache AirflowBackup childcare | Financial coaching | Health care coverage | Mental health support | On Site Health Wellness CentersSenior-level Full TimeOH, United States18h ago
-
Data Architect, AI and Data Practice USD 130K-190KAI Foundry | AWS Glue | Amazon Redshift | Amazon S3 | Azure AISenior-level Full TimeHouston, United States18h ago
-
Apache Spark | Azure Synapse | DAX | Data Lake | Data ModelingBirthday day off | Life insurance | Prepaid medicine | Work from homeMid-level Full TimeColombia, United States R18h ago
-
Algorithms | Data Structures | Deep learning | Ensemble learning | Graph theory401k matching | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States19h ago
-
AI Infrastructure Engineer - Recommendation & LLM USD 160K-220KAlgorithms | C++ | CUDA | CUDA graph | Computer ArchitectureSenior-level Full TimeSan Jose, California, United States19h ago
-
C++ | Computer Vision | Deep learning | Domain Adaptation | FlinkCareer growth opportunities | Onboarding supportEntry-level Full TimeSan Jose, California, United States19h ago
-
Apache Flink | Apache Hive | Apache Spark | C++ | Computer VisionComplex problem solving | Growth opportunities | Team collaborationEntry-level Full TimeSeattle, Washington, United States19h ago
-
Research Engineer, Synthetic Data Generation USD 141K-208K3D Geometry | Avatar Rendering | C++ | Computer Graphics | Computer VisionCross-functional collaboration | Mentoring opportunitiesSenior-level Full TimeBurlingame, CA20h ago
-
Software Engineer, Search Platforms, GenAI Content USD 262K-364KComputer Vision | Data Processing | Debugging | Deep learning | Distributed ComputingSenior-level Full TimeMountain View, CA, USA20h ago
-
Software Engineer III, Generative AI, Core USD 147K-210KCode review | Debugging | Distributed Computing | Generative AI | Language ModelsSenior-level Full TimeSan Jose, CA, USA20h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-221KAnalytics Warehousing | Apache Spark | Batch Processing | Big Data | Cloud ComputingSenior-level Full TimeReston, VA, USA; Washington D.C., DC, …20h ago
-
AI/ML Accelerator Modeling Engineer, Silicon USD 138K-197KAI machine learning | Accelerator architecture | C# | C++ | C-ModelMid-level Full TimeMountain View, CA, USA20h ago
-
Research Engineer, Serving Quality, DeepMind USD 174K-252KC++ | JAX | Machine Learning | Python | StatisticsSenior-level Full TimeMountain View, CA, USA20h ago
-
Senior Data Engineer USD 125K-153KAWS DMS | AWS Glue | Agile | Amazon Redshift | Amazon S3Healthcare | Language courses | Life insurance | Long-term disability | Paid certificationsSenior-level Full TimeUnited States22h ago
-
Embedded Systems Engineer USD 90K-120KAUTOSAR | Automated testing | C++ | CAN | CANoe401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeChillicothe, IL23h ago
-
Senior Machine Learning Engineer USD 171K-270KAWS | Agentic Systems | Amazon EKS | Azure | CI/CD25 annual days of vacations | Coffee and fruit | Flexible working hours | Gym allowance | Health insuranceSenior-level Full TimeLisbon IT Campus - Swiss Post23h ago
-
Senior Full Stack AI Developer USD 125K-185KAWS | Application development | Azure | CI/CD | Cloud EngineeringEmployee benefits | Government security clearance assistance | Remote workSenior-level Full TimeWork from home, VA, United States23h ago
-
Mid-level Full TimeARLINGTON, VA, United States23h ago
-
Load Forecasting Data Scientist USD 86K-120KBig Data | Data Wrangling | Data munging | Data pipeline | Geospatial AnalyticsEmployee assistance program | Flexible work hours | Hybrid work environment | Paid time off | Professional developmentMid-level Full TimeWindsor, CT, 06095, USA R23h ago
-
A/AI Machine Learning Engineering Sr - E3 USD 110K-204KA Star | C++ | CUDA | Computer Vision | Database401k match | EAP | Education assistance | Flexible spending accounts | Flexible work arrangementsSenior-level Full TimeVirtual Two, CO, US1d ago