Study of Machine Learning Techniques using Apache Spark
Keywords:
weather forecast, virtualization, Hadoop, Spark, latencyAbstract
The challenges in the field of big data analysis is growing due to the huge volume of data collected on daily basis by social media, weather forecast, mobile data etc. In this survey paper, there is a look on different aspects of usage of Apache spark, be it, the framework, the libraries, the spark technologies etc. The spark platform provides various algorithms to analyse machine learning techniques and implement them on other virtualization platforms such as VMware vSphere. Further, Spark is used on different platforms to achieve high performance, overcome latency and achieve efficiency. The papers, studied here, have drawn parallelism between the Hadoop and the Spark and the latter has proved to be the best platform as it is hundred times faster and more efficient.
References
- SPARK—A Big Data Processing Platform for Machine Learning. Jian Fu, Junwei Sun,Kaiyuan Wang. Wuhan, Hubei, China : IEEE, 2016.
- A Big Data Analysis Framework Using Apache Spark and Deep Learnig. Anand Gupta, Hardeo Kumar Thakur. Delhi, India : s.n., 2017.
- Big Data Machine Learning using Apache Spark MLlib. Mehdi Assefi, Ehsun Behravesh, Guangchi Liu, Ahmad P. Tafti. USA : s.n., 2017.
- Research of Intrusion Detection Algorithm Based on Parallel SVM on Spark. Hongbing Wang, Youan Xiao and Yihong Long. Wuhan, Hubei Province, China : s.n.
- Online Internet Traffic Monitoring System Using Spark Streaming. 2018.
- Shade: A Differentially-Private Wrapper For Enterprise Big Data. Alexander Heifetz, Vaikkunth Mugunthan and Lalana Kagal. Cambridge, USA : s.n., 2017.
- Spark-BDD: Debugging Big Data Applications. Tyson Condie, Muhammad Ali Gulzar, Matteo Interlandi, Miryung Kim,Todd Millstein Sai, Deep Tetali, Seunghyun Yoo. California, Los Angeles : s.n.
- Spark-SIFT: A Spark-Based Large-Scale Image Feature Extract System. xinming Zhan, YaoHua Yang, Li Shen. china : s.n., 2017.
- Parallelization of a Series of Extreme Learning Machine Algorithms Based on Spark. Tiantian Liu, Zhiyi Fang, Chen Zhao, Yingmin Zhou. china : s.n.
- Weather data analysis using Spark – An In-memory Computing framework. Ms.D.Jayanthi, Dr.G.Sumathi. INDIA : s.n., 2017.
- Towards Development of Spark Based Agricultural Information System including Geo-Spatial Data. Purnima Shah, Deepak Hiremath,Sanjay Chaudhary. Ahmedabad, India : s.n., 2017.
- Scaling Machine Learning for Target Prediction in Drug Discovery using Apache Spark. Dries Harnie, Alexander E Vapirev, Jorg Kurt Wegner, Andery Gedich, Marvin Steijaert,Roel Wuyts and Wolfgang De Meuter. Belgium : s.n., 2015.
- Research on the forecast of Shared Bicycle rental demand based on spark machine learning framework. Zilu Kng, Yuting Zuo, Zhivin Huang, Feng Zhou, Penghui Chen. china : s.n., 2017.
- Real Time Road Traffic Event Detection using Twitter and Spark. Ketan R. Pandhare, Medha A Shah. India : s.n., 2017.
- Mobile Big Data Analytics Using Deep Learning and Apache Spark. Mohammad Abu Alsheikh, Dusit Niyato, Shaowei Lin, Hwee-Pink Tan, and Zhu Han. 2016.
- Survey on High Performance Analytics of Bigdata with Apache Spark. Ramkrushna C. Maheshwar, D. Haritha. India : s.n., 2016.
Downloads
Published
Issue
Section
License
Copyright (c) IJSRCSEIT
This work is licensed under a Creative Commons Attribution 4.0 International License.