Big data: Issues, challenges, tools and Good practices

• Published in: 2013 Sixth International Conference on Contemporary Computing (IC3) pp. 404 - 409
• Main Authors: Katal, Avita, Wazid, Mohammad, Goudar, R. H.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.08.2013
• Subjects: Big data; Data handling; Data storage systems; File systems; Hadoop; Hadoop Distributed File System; Information management; MapReduce; Media
• DOI: 10.1109/IC3.2013.6612229

Big data is defined as large amount of data which requires new technologies and architectures so that it becomes possible to extract value from it by capturing and analysis process. Due to such large size of data it becomes very difficult to perform effective analysis using the existing traditional techniques. Big data due to its various properties like volume, velocity, variety, variability, value and complexity put forward many challenges. Since Big data is a recent upcoming technology in the market which can bring huge benefits to the business organizations, it becomes necessary that various challenges and issues associated in bringing and adapting to this technology are brought into light. This paper introduces the Big data technology along with its importance in the modern world and existing projects which are effective and important in changing the concept of science into big science and society too. The various challenges and issues in adapting and accepting Big data technology, its tools (Hadoop) are also discussed in detail along with the problems Hadoop is facing. The paper concludes with the Good Big data practices to be followed.