Big Data Application Developer
Tasks
- Analyze large-scale data
- Build analytics platforms
- Debug pipeline failures
- Design data processing pipelines
- Develop Apache Spark jobs
- Document data engineering processes
- Ensure cost effective production operations
- Ensure reliable data platform performance
- Implement data workflows orchestration
- Ingest structured data
- Ingest unstructured data
- Operate Hadoop ecosystems
- Transform data for analytics
- Troubleshoot data platform issues
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBase | Apache Hadoop | Apache Hive | Apache Hudi | Apache Kafka | Apache Spark | Apache Sqoop | Azure HDInsight | CI/CD | Collibra | Databricks | Delta Lake | Distributed Systems | Fault Tolerance | Hadoop HDFS | Iceberg | Infrastructure as Code | Java | Kubernetes | NoSQL | Oozie | Partitioning | Python | Python Scripting | Replication | SQL | Scala | Shell Scripting | Spark Streaming | Trino | “as-code”
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
Charm Security-Forward Deployed AI Engineer USD 140K-200KAI Agents | API | Agentic Workflows | Automation | Backend DevelopmentCustomer Site Workshops | Travel opportunitiesMid-level Full TimeRemote, OR, US R9h ago
-
Data Engineer - AI, Hybrid USD 137K-200KDBT | Data Cleansing | Data Imputation | Data Modeling | Data Quality401k matching contribution | 401k plan | Disability coverage | Hybrid work model | Life insuranceSenior-level Full TimeUSA-RESEARCH TRIANGLE PARK, United States R21h ago
-
Senior-level Full TimeUnited States - Remote R21h ago
-
AI Interaction Designer USD 140K-155KAgent Frameworks | Deterministic systems | Embeddings | Evaluation | LLM APIsRemote workMid-level Full TimeUnited States - Remote R21h ago
-
AI Research Engineer USD 100K-150KAccelerators | Computer Vision | Data labeling | Deep learning | Distributed TrainingSenior-level Full TimeUnited States - Remote R21h ago
-
Analytics Data Engineer USD 100K-120KAWS | Artificial Intelligence | Automation Scripting | Azure | CI/CD401k matching | All-hands meetings | Cell phone reimbursement | Dental insurance | FSA accountSenior-level Full TimeUnited States - Remote R21h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R21h ago
-
Data Engineer USD 72K-130KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R21h ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionRemote workSenior-level Full TimeUnited States - Remote R21h ago
-
ML Data Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingCareer growth | Remote workMid-level Full TimeUnited States - Remote R21h ago
-
Data Platform Engineer USD 100K-150KAutoscaling | C++ | CUDA | Capacity Planning | Distributed SystemsCareer growth | Remote workSenior-level Full TimeUnited States - Remote R21h ago
-
Embedded Robotics Engineer USD 125K-145KC++ | Concurrent programming | Control Systems | Critical software | DebuggingCareer growth | Remote workSenior-level Full TimeUnited States - Remote R21h ago
-
LLM Engineer USD 100K-150KDPO | Dataset curation | DeepSpeed | Evaluation | FSDPCareer growth | Remote work opportunitySenior-level Full TimeUnited States - Remote R21h ago
-
Machine Learning Engineer – RL USD 155K-180KDeep learning | GPU Computing | Hierarchical reinforcement learning | Multi-Agent | Multi-Agent Reinforcement LearningCareer growth potential | Full time direct employment | H1B transfer support | Remote workSenior-level Full TimeUnited States - Remote R21h ago
-
Azure Data and MLOps Engineer USD 116K-222KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data Lake401k match | Company paid life insurance | Company paid vision plan | Company-paid disability insurance | PTOSenior-level ContractUnited States - Remote R21h ago
-
Prompt Engineer USD 100K-150KAgent Frameworks | Embeddings | Evaluation Pipelines | Fine Tuning | LLM APIsSenior-level Full TimeUnited States - Remote R21h ago
-
Associate, Quantitative Developer, Model Portfolio Solutions (MPS), Multi-Asset Strategies & Solutions (MASS) USD 116K-155KAPIs | Backtesting | Cause analysis | Code Reviews | Data ArchitectureComprehensive healthcare | Flexible time off | Hybrid work model | Leave benefits | Retirement benefitsMid-level Full TimeSF4-San Francisco - 400 Howard Street, … R21h ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Concurrent programming | Control Systems | Embedded SystemsCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R21h ago
-
Robotics Solutions Engineer USD 100K-150KC++ | Concurrent Systems | Control | Debugging | GazeboCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R21h ago
-
Senior Staff AI Engineer USD 135K-178KAPI Development | AWS | Airflow | Anthropic | AutogenDiversity and inclusion | Employee mentoring | Inclusive culture | Remote work optionsSenior-level Full TimeOakland, CA; Remote (United States) R1d ago
-
AI Center | AI orchestration | Action Center | Agile | AuthenticationMid-level ContractNashville, United States R2d ago
-
Applied AI Engineer, Investments USD 134K-183KAPIs | Cloud Computing | Data Pipelines | Data Quality | Data ValidationEmployer 401k match | Family forming benefits funding | Hybrid work onsite at least 60 percent of the time | Paid time off | Relocation supportNone Full TimeRedwood City, CA (Hybrid) R2d ago
-
Edge Computing AI Engineer USD 100K-150KC++ | DSP Toolchains | Device optimization | Device security | Edge inferenceMid-level Full TimeUnited States - Remote R2d ago
-
Generative AI Engineer USD 100K-150KBenchmarks | Dataset Construction | Direct Preference Optimization | Distributed Training | EvaluationCareer growth | Remote workMid-level Full TimeUnited States - Remote R2d ago