Big Data and Its Challenges
Keywords:
Big Data, Data Quality, SecurityAbstract
Big Data is still a maturing and evolving discipline. Big data databases and files have scaled beyond the capacities and capabilities of commercial database management systems. Structured representations become a bottleneck to efficient data storage and retrieval. Gartner has noted four major challenges (the four Vs): increasing volume of data, increasing velocity (e.g., in/out and change of data), increasing variety of data types and structures, and increasing variability of data. A fifth V: value is suggested, which is the contribution big data has to decision making. Add to these the increasing number of disciplines and problem domains where big data is having an impact and one sees an increase in the number of challenges and opportunities for big data to have a major impact on business, science, and government.
References
- T. Kalil:,Big data is a big deal available at: http://www.whitehouse.gov/blog/2012/03/29/big-data-big-deal (2012).
- boyd, dana; Crawford, Kate (21 September 2011). "Six Provocations for Big Data". Social Science Research Network: A Decade in Internet Time: Symposium on the Dynamics of the Internet and Society. doi:10.2139/ssrn.1926431.
- David Gewirtz for DIY-IT | April 20, 2016 -- 12:47 GMT (18:17 IST) | Topic: Big Data Analytics
- October 2, 2013Pinal DaveBig Data, SQL, SQL Server, SQL Tips and Tricks
- \Laney, D.: 3D data managsement: controlling data volume, velocity and variety. Appl. Deliv. Strateg. File, 949 (2001)
- https://www.impactradius.com/blog/7-vs-big-data
- http://www.sagese.com/dosage/volume-velocity-value
- QIN Xiong-Pai, WANG Hui-Ju, DU Xiao-Yong,WANG shan . Big Data Analysis-Compitition and Symbosis of RBDMS and MapReduce J]. Journal of Software. 2012, 23(1):32-45.
- Tan Xiongpai, Wang Huiju,Li Furong,et al. New Landscape of Data Management Technologies J]. journal of Software.2013, 24(2):175-197.
- CHEN Hai-Ming, CUI Li, XIE Kai-Bin. A Comparative Study on Architechtures and Implementation Methodologies of internet of Things J]. Chinese Journal of Computers 2013, 36(1): 168-188.
- Lee E A, Seshia S A. Introduction to embedded systems: A cyber-physical systems approach M]. Lee & Seshia, 2011.
- Thusoo A, Sarma J S, Jain n,et al. Hive-A Petabyte Scale data warehouse using Hadoop C]. Proc.of ICDE 2010. Piscataway,NJ: IEEE, 2010: 996-1005.
- Abouzied A, Bajada-Pawlikowski K, Huang Jiewen. Hadoop DB in action: Building real world applications C]. Proc. of SIGMOD 2010, New York: ACM, 2010: 1111-1114.
- Chen Songting, Cheetah: A high performance, custom data warehouse on top of MapReduce J]. PVLDB, 2010, 3(2): 1459-1468.
- Jonathan T. Overpeck, Gerald A. Meehl, Sandrine Bony, and David R. Easterling. Climate Data Challenges in the 21st Century J]. Science, 2011, 331(6018): 700-702
Downloads
Published
Issue
Section
License
Copyright (c) IJSRCSEIT
This work is licensed under a Creative Commons Attribution 4.0 International License.