الوصف الوظيفي
SUMMARY
You will architect and develop Pegb data platform designed to support massive scale structured and unstructured real-time data. You will lead the design and development of distributed data infrastructure that is scalable, highly performant and able to handle diverse data sets.
Duties and Responsibilities
• Build data storage and processing platform – work on improving and adding new functionality to Pegb distributed systems backbone.
• Help troubleshoot, tune and optimize data systems and application operational issues.
• Work with large datasets: ETL, processing, aggregation, migrations and queries.
• Support benchmarking systems, analyze system & query bottlenecks and propose solutions to eliminate them.
• Design and implement features evolving our data platform product offerings.
• Deliver software designs that have resilience, performance and security baked into their DNA.
• Mentor junior members.
• Work with Product management on understanding features.
• Own a problem end to end.
المهارات
Qualification
• Bachelor’s Degree in Computer Science or related technical discipline or its equivalent.
• 5+ years of professional experience focusing on building and managing data distributed data infrastructure using open source software in a large-scale environment.
• 3+ years in a direct role as a designer / architect for ETL and/or Data Warehouse systems.
• 3+ Years - Data Modeling Experience; Delivering both logical models and physical data structure designs.
• 3+ years of experience with Massive Parallel Processing relational databases (any of Vertica/Redshift/Teradata).
• Technical expertise in data platform architecture, design, and development.
Knowledge and Experience
• Proficiency with agile development methodologies.
• Proficiency with linux/unix based systems.
• Proficiency with Big Data processing technologies (Hadoop, Spark).
• Proficiency with data warehouse solutions (any of Vertica/Redshift/Teradata).
• Proficiency with Git (Bitbucket, GitHub).
• Hands on experience with the latest technologies: MySQL, Cassandra, MongoDB, CouchBase Kafka, ElasticSearch.
• Experience in a startup.
• Experience with containerized applications running in Docker, Kubernetes is preferred.
• Experience with SCALA, Akka is preferred.
Skills
• Can think critically through hard problems and emerge with robust, functional solutions.
• Can work with others to produce industrial strength code.
• Excellent written and verbal communication skills
تفاصيل الوظيفة
منطقة الوظيفة دبي, الإمارات العربية المتحدة
قطاع الشركة تكنولوجيا المعلومات
طبيعة عمل الشركة صاحب عمل (القطاع الخاص)
الدور الوظيفي تكنولوجيا المعلومات
نوع التوظيف دوام كامل
الراتب الشهري غير محدد
عدد الوظائف الشاغرة غير محدد
الرقم المرجعي للوظيفة JB3807218
المرشح المفضل
المستوى المهني متوسط الخبرة
عدد سنوات الخبرة الحد الأدنى: 5
الشهادة بكالوريوس/ دبلوم عالي
https://www.bayt.com/ar/uae/jobs/data-engineer-architect-3807218/
نسخة للطباعة 
ابلغ عن اعلان مخالف