Career Profile
Software engineer with more than 20 years of experience. In the last 10 years focused on BigData and AI domains and speciallized in batch processing and advanced analytics using Spark.
Experiences
Hands-on consulting on BigData advanced analytics. Covering all the aspects from research to production. The main tech expertise is Spark-based applications.
Leading the technology and analytics aspects for a group of four teams that develops advanced BigData analytics solutions for PayPal’s global data science group. Deep knowledge of the Hadoop ecosystem - especially Spark and Hive, distributed graph algorithms (entity resolution, community detection, etc.), and the ML life cycle from research to production.
- Open-sourced Dione - an indexing framework for Spark.
BigData developer in PayPal’s Global Data Science team with experience in all the solution life cycle - from research to deployment and production maintenance.
- Research - Talk on distributed graph algorithms for community detection at the Jerusalem data science summit 2017.
- Dev - Spark PRs - SPARK-16469, SPARK-19368, SPARK-21657, SPARK-34416
Designed and developed the company’s data and analytics pipeline from web scraping, ETL, analytics and feature engineering, and machine learning model execution. Built using Hive, Hadoop, Python, and Java.
Archisoft is an IDF consulting company (Acquired by One1). Worked there during my studies as a product manager and software engineer in a large-scale operational project for the Israeli Air Force.
Worked on IAF’s leading operational software project.