Senior Data Engineer
New York, United States
R
USD 90K-110K (estimate) Senior-level Full Time
Tasks
- Automate data cleaning with logging
- Build ETL and data warehousing
- Build Kafka data flows
- Build data processors in Nifi
- Collaborate to improve scalability and consistency
- Convert data between external and internal representations
- Create data pipeline triggers and filters
- Design data models
- Design data pipelines
- Develop Nifi ingestion pipelines
- Establish unit testing for pipelines
- Follow data engineering best practices with scalable architecture
- Implement monitoring and error handling
- Use Docker for development testing environments
- Use Jira for agile delivery
- Write SQL queries for analytics and debugging
Perks/Benefits
- Autonomy
- Employee assistance program
- Flexible working hours
- Inclusive community
- Online training videos
- Teambuilding events
- Telecommuting
- Well-being app
Skills/Tech-stack
Agile | Amazon Web Services | Apache NiFi | Data Modeling | Data Warehousing | Docker | ETL | Java | Jira | Kafka | Python | SQL | Unit Testing | Web Services
Roles
Related jobs
-
GCP/Linux Data Engineer (Remote) USD 95K-170KAPIs | Agile | CI/CD | Cloud automation | Cloud platformFully remote | W2 Candidates OnlyMid-level Full TimeRochester, MN R8h ago
-
A/B | A/B Testing | AI Model Deployment | AI model | App ServiceRemote workMid-level ContractHartford, United States R8h ago
-
Senior Software Engineer, Storage USD 217K-303KC++ | Caching | Cassandra | Data Storage | Distributed Systems401k employer match | Dental insurance | Equity compensation | Generous time off | Medical insuranceSenior-level Full TimeRemote - United States R21h ago
-
Data Engineer, Go To Market (Remote) USD 100K-155KAmazon Redshift | Apache Airflow | CI/CD | CRM | DBTSenior-level Full TimeUSA CA Remote, United States R22h ago
-
Machine Learning Engineer USD 196K-196KApache Airflow | CI/CD | Containerization | Docker | Experiment trackingFully remoteSenior-level Full TimeSan Francisco, CA R23h ago
-
AWS Bedrock | Agent systems | Anthropic API | Autogen | Azure401k matching program | Adoption Assistance | Development and career growth opportunities | Fertility treatments | Flexible work schedulesSenior-level Contract Full TimeRemote, OR, United States R1d ago
-
Software Engineer, Applied AI USD 190K-280KContext engineering | Data Processing | Data Storage | Debugging | Docker401k match | Dental insurance | Health insurance | Hybrid work model | Professional developmentSenior-level Full TimeNew York City R1d ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | BigQuery | Cloud Composer | Cloud Data401k retirement plan | Dental insurance | Disability insurance | Flexible time off | Health insuranceMid-level Full TimeLisle, IL, United States R1d ago
-
Senior Staff Data Engineer - Platform Data and Analytics USD 268K-368KAirflow | Alerting | Apache Spark | Capacity Planning | Cost OptimizationSenior-level Full TimeSan Francisco, CA R1d ago
-
Staff Data Engineer USD 185K-220KAWS | Apache Airflow | Apache Kafka | Benthos | Big DataDental insurance | Disability insurance | Flexible work hours | Health insurance | Health savings accountSenior-level Full TimeRosslyn, VA or Remote R1d ago
-
API Testing | Cypher | Data Quality | DataOps | DevOpsBenefits | Competitive pay | Growth opportunity | Remote work | Travel requiredSenior-level Full TimeReston, VA, United States R1d ago
-
Principal Engineer - Data Platform USD 221K-387KAWS | Airflow | Apache Hive | Apache Iceberg | Apache ImpalaRemote workSenior-level Full TimeSanta Clara, California, United States R1d ago
-
IT Infrastructure Engineer II USD 139K-178KAWS Organizations | Access Management | Amazon Web Services | Ansible | Application FirewallHealth and wellness resources | Remote work | Wellness FridaysSenior-level Full TimeRemote - United States R1d ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Data Analysis | Data AssociationDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R1d ago
-
Senior Data and AI Platform Engineer USD 150K-230KAnalytics engineering | CI/CD | DBT | Data Engineering | Data GovernanceCross-functional collaboration | Learning opportunities | Occasional travel | Technical mentorshipSenior-level Full TimeRemote - US R1d ago
-
Analytics Engineer USD 110K-135KDBT | Data Architecture | Data Modeling | Data Quality | Data Warehouse401k | Dental insurance | Employee discounts | Fully remote | Medical insuranceEntry-level Full TimeNew York, NEW YORK, United States R1d ago
-
Senior Data Engineer - Databricks USD 180K-248KAWS | Access Control | Amazon Web Services | Apache Spark | Automated testing401k match | Corporate Benefit Program | Discounted pet insurance | Educational resources | Employee Referral Bonus ProgramSenior-level Full TimeUS - Remote R1d ago
-
Software Engineer, ML Dev Enablement USD 123K-163KAWS | Agentic AI | C++ | DDP | Data pipeline401k with company match | Dental insurance | Health savings account | Hybrid schedule | Life insuranceSenior-level Full TimeLas Vegas, Nevada, United States; Remote … R1d ago
-
Data Manipulation | Distributed Systems | Embeddings | Java | KubernetesCollaborative flat culture | Direct access to technical leadership | Exposure to cutting edge generative AI | Flexible schedule | High autonomyEntry-level Full TimeCanada R1d ago
-
Cloud Data | Cloud Data Platforms | DBT | Data Architecture | Data ProcessingCoworking allowance | Flexible paid time off | Health, dental and vision coverage | Home office stipend | Mental health resourcesSenior-level Full TimeCanada R1d ago
-
Azure Data | Azure Data Lakehouse | Azure SQL | DBT | Data GovernanceCareer growth | Continuous learning | Dental insurance | Flexible work arrangements | Global collaborationSenior-level Full TimeCanada R1d ago
-
API Integration | CRM | Context Management | Distributed Systems | Document stores401k retirement plan | Company offsite and team events | Flexible PTO | Fully remote | Health, dental, and vision insuranceSenior-level Full TimeCanada R1d ago
-
AWS Glue | AWS Lambda | AWS S3 | Access Control | Data GovernanceCareer growth opportunities | Collaborative and inclusive work environment | Diverse and inclusive culture | Flexible work arrangements | Permanent remote working modelSenior-level Full TimeCanada R1d ago
-
Senior Data Engineer USD 135K-205KAzure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Machine Learning401k matching | Continuing education assistance | Medical, dental & vision coverage | Paid time offSenior-level Full TimeArlington, VA, United States R1d ago
-
Senior Platform Engineer, Data & AI USD 140K-160KAPI Development | AWS | Alerting | Bash | CI/CDEmployee growth opportunities | Leadership programs | Mentorship programsSenior-level Full TimeUnited States R1d ago