Vellore Institute of Technology

MIS 0029

Project Report for J component of Course Code: SWE2011, Course Title: Big Data Analytics Faculty: C.Ranichandra , Slot: B1+TB1 Semester : Fall semester 2021-22 On Title: FBI Crime data analysis using Hadoop and Mysql By Regno: 18MIS0029 18MIS0051 3. Table of contents, topic with page no. 1. Abstract 2. Dicovery phase: 2. a problem Satement 2.b Literature Survey 2.c S/w and H/w requirements 3 Data Preparation Phase 3. a Data Set Description 3.b Data Pre- processing 4 Model planning 4. a Module-1 Data Pre-processing 4.b Module-2 Data Migration Module with Sqoop 4.c)Module -3 Data Analytic Module with Hive 4.d)Module -4 Data Analytic module with MapReduce 4.e) Module -5 Python programming 5. Model Building Implentation of Module -1 Implentation of Module -2 Implentation of Module -3 Implentation of Module -4 Implentation of Module -5 6. Communicating Results Output of each phase Comparision charts 7. conclusion 8. References 9. Appendix ABSTRACT: Big data is the voluminous and complex collection of data that comes from different sources such as sensors, content posted on social media website, sale purchase transaction etc. Such voluminous data becomes tough to process using ancient processing application. There are various tools and techniques in the market for big data analytics. With continually increasing population, crimes and crime rate analyzing related data is a huge issue for governments to make strategic decisions so as to maintain law and order. This is really necessary to keep the citizens of the country safe from crimes. The best place to look up to find room for improvement is the voluminous raw data that is generated on a regular basis from various sources by applying Big Data Analytics (BDA) which helps to analyze certain trends that must be discovered, so that law and order can be maintained properly and there is a sense of safety and well-being among the citizens of the country. Cyber crime is the new age concern which has originated due to the increasing growth and advancements in computer systems and networks, which has given rise to a new environment for criminal activities. Regular occurrences of the crime incidents pose a serious threat to the safety and well-being of the society. This paper offers a extensive overview of crime occurrences and their relevance in literature by combining approaches. The paper initially reviews and identifies features of crime incidents proposing a combinatorial incident description schema. The proposed schema intends to raise a opportunity to systematically combine different elements, or crime characteristics. Additionally, a comprehensive list of crime-related offences is put forward. This enables a thorough understanding of the repeating and underlying criminal activities. This paper intends to be of use to specialists and law enforcement officers in discovering patterns and trends for making forecasts, finding relationship and possible explanations 2)Discovery Phase 2.a)Problem Statement: In today’s world, every establishment is facing ever growing challenges which need to be coped up quickly and efficiently. With continually increasing population, crimes and crime rate analyzing related data is a huge issue for governments to make strategic decisions so as to maintain law and order. This is really necessary to keep the citizens of the country safe from crimes. The best place to look up to find room for improvement is the voluminous raw data that is generated on a regular basis from various sources by applying Big Data Analytics (BDA). BDA refers to the tools and practices that can be used for transforming the raw data into meaningful and crucial information which helps in forming a decision support system for the judiciary and legislature to take steps towards keeping crimes in check. With the ever increasing population and crime rates, certain trends must be discovered, studied and discussed to take well informed decisions so that law and order can be maintained properly and there is a sense of safety and well-being among the citizens of the country Proposed system: The proposed system deals with providing database with high throughput and low maintenance cost using Hadoop tools containing HDFS and map reduce programs. The project will be implemented using Hadoop and be graphically pre-sented using python programming..The proposed schema could be ex-tended with suggestions to recommend actions, correspond-ing measures and constructive policies according to the of-fence type and the subsequent crime incident. This matching will ensure better security,monitoring,handling and preven-tion of criminal act occurrences. 2.b) Literature Survey: 1)https://www.sciencedirect