Analytical observations of Weblog


Job #: 10134 Post Date: 09.07.2017 14:12

General information for the business: We build softwares Kind of development: New program from scratch Num. of modules: 1 Description of every module: The challenge is to make analytical observations about the data Description of requirements/functionality: The challenge is to make analytical observations about the data using the tools below. ## Processing & Analytical goals: 1. Sessionize the weblog by IP. Sessionize = aggregate all page hits by visitor/IP during a fixed time window. 2. Determine the average session time 3. Determine unique URL visits per session. To clarify, count a hit to a unique URL only once per session. 4. Find the most engaged users, ie the IPs with the longest session times ### Tools allowed (in no particular order): - MySQL, PostgreSQL or any other RDBMS - SQL language - Linux - Java ### Additional notes: - You are allowed to use whatever libraries/parsers/solutions you can find provided you can explain the functions you are implementing in detail. - IP addresses do not guarantee distinct users, but this is the limitation of the data. As a bonus, consider what additional data would help make better analytical conclusions - For this dataset, complete the sessionization by time window rather than navigation. Feel free to determine the best session window time on your own, or start with 15 minutes. - The log file was taken from an AWS Elastic Load Balancer: ## How to complete this challenge: A. Complete the processing and analytics as defined first to the best of your ability with the time provided. B. Place notes in your code to help with clarity where appropriate. Make it readable enough to present to others. C. Complete your work in your own github repo and send the results to us and/or present them during your interview. ## What are we looking for? What does this prove? We want to see how you handle: - New technologies and frameworks - Messy (ie real) data - Understanding data transformation This is not a pass or fail test, we want to hear about your challenges and your successes with this particular problem. Specific technologies required: Java, MySQL, SQL language OS requirements: Windows, Linux Extra notes:

Posted by

Required skills


Get the job done

Job type:
Hiring from:

?Bidding for first time? Click here to learn how StartAJob platform works.

?Want to do the job or have questions for the customer? Write then in the " Write a note or message to the customer"

?You already have the estimated cost and time to complete the work yuo are in the fields "Execution time" and "Payment requested" or leave them empty and can be changed later.