Thank you for your Original Content, /u/oli-hall!Here is some important information about this post:
Not satisfied with this visual? Think you can do better? Remix this visual with the data in the citation, or read the !Sidebar summon below.
OC-Bot v2.2.3 | Fork with my code | How I Work
Love this graphic but really would like to see the energy sector result broken down by source a little better. Where are you getting the raw data?
Source Data: EU emissions data (EU Emissions data by country and sector reported to the UNFCCC and to the EU Greenhouse Gas Monitoring Mechanism)
Chart created using SankeyMATIC
Units are millions of tonnes of CO2-equivalent (sometimes delightfully measured in teragrams/tg).
The original chart, with a couple of per-sector breakdowns are here
I extracted the data using the EU GHG emissions viewer, but the certificate has expired since then so might be a bit tricky to access now. I'd like to dive into the full dataset, but haven't found anything that can comfortably open a 180MB MS Access file without crashing (suggestions welcome).
I've tweaked a few of the names and combined categories in places to make the chart a bit more readable. I've also combined Biomass and International Aviation/Shipping into the Energy totals, as they're not counted as part of the EU Emissions Trading Scheme so whilst they're recorded, they're not included into the official EU totals.
I've also got a bunch of historical trends for many of the sectors (1990-2016), which I'd be happy to post if anyone's interested. Also, if anyone has suggestions on different views, or would like to see more detail on specific sectors I'd be happy to post charts of those too!
Expand More Comments
Thank you for your Original Content, /u/VanillaMonster!Here is some important information about this post:
This is a scene taken from my data documentary: "Economic History of Latin America". You can get it in any of the three languages here:
English - https://youtu.be/kl7-c0CuNDI
Spanish - https://youtu.be/hRtM0RYcamU
Portuguese - https://youtu.be/uojeP3drBTs
This visualization was made using flourish.studio and filmora 9. I used data from The Madison Project database and the world bank.
Always call out when your Y axis isn’t zero. Makes proportions look more dramatic (although sometimes the decision makes sense to show it that way)
Thank you for your Original Content, /u/yougoodcunt!Here is some important information about this post:
Facebook provides a ".json" of the most recent 999 entries of location access data, roughly 3 months in my case.
This database is easily downloaded through Facebooks Security Page.
This data was converted from .json to .csv.
The program running the visualisation is QGIS, a free GIS mapping application, with the Google Maps Tile Server data and overlayed with the raw location data, and created a heatmap of point densities. I also created another layer that uses the UNIX timestamp information to plot out the order of pings for better understanding of movement.
I then added a slightly less obvious heatmap (purple) using a simple time/distance algorithm where the purple is denser when the distance between pings is calculated and then compared to the timestamp of the preceding point. this in effect shows how slowly I'm moving in traffic, i.e. the areas where I'm moving slowly, thresholded (low-cut filtered) at about 20% to avoid a messy output. This is a heatmap of the matrix created using the aforementioned algorithm, not a linear process like the lines layer.
All in all - I've learnt that Facebook 100% knows where I live, where I work (and how i get there), knows where my friends live, which fast food i eat, the stores i visit, etc..
The original idea was to create a predictive neutral network to predict where I'll be at any given time and day out the week (12pm on a weekday should correlate to me being at work, for instance) and am in the process of creating a script that lets you upload and analyse your own Facebook data. Tossing up between an online form or a downloadable. exe, both have potential security risks and I'm weighing up the benefits of each.
i think it's incredibly important to be aware of the personal big data corporations have, and that disabling location unless it's entirely necessary is an absolute no-brainer. Needing pinpoint accuracy to give you a weather forecast are the kind of "features" that companies use to acquire this data. in the case of Facebook - i actually cannot remember for the life of me why they "needed" to collect this data besides data mining and advertising mechanisms.
Thank you for your Original Content, /u/meatenigma!Here is some important information about this post:
This is a follow up post to My 500 days on OkCupid.
Excel and http://sankeymatic.com/build/ for the chart
Source: my profile
Comparisons: Here is a side by side comparison of the first 500 days (top) and the second (bottom) and an album view of everything
You've gotta be doing something terribly wrong. I'm an average guy in low 30s. I used a mix of okcupid, plenty of fish, and eharmony. About 25% of my massages led to dates, mostly realizing we weren't compatible while grabbing food. Eventually found the right 1 and on our year and a half mark.
When you tailor messages make sure it shows that you read their profile; comment on something they wrote, ask questions, etc.
Never use canned messages.
Less pictures is more. Find your best 2 or 3 recent pictures and just use those. If you have a bunch they might not like how you look in just 1 of the 10 you post, but it will worry them that the 1 picture they don't like will be more ofv what you look for. With the one I ended up with I actually used no pictures. I don't consider myself photogenic at all but know I'm decent looking in person, so no point in handicapping myself.
Also, lots of girls on those sites just want a free dinner.. weed those out by suggesting a cheap date. A girl actually looking for a real date won't care, they will just want to get to know you.
Thank you for your Original Content, /u/bbqchickenbball!Here is some important information about this post:
For others curious, the "NA" are players who never appeared in an NBA game. The most notable here is 1986's #2 pick Len Bias, who died two days after the draft from a drug overdose.
Since 2002, there has not been a #1 pick that has been legally allowed to drink (in US).
Forgive my ignorance regarding basketball drafts, but what does the "NA" mean in this context? Surely every draftee has an age. Does it mean there was no pick for that slot? Wouldn't that mean that the next pick is the data point for that slot? For example, in 1984 there is no data for the 26th pick. But that would mean that the next pick was actually the 26th pick and not the 27th, right? Is there some idiosyncrasy of basketball drafts that causes a particular pick to remain open?
Sorry for all the confusion on my part. Otherwise the data is presented exceptionally well and is, indeed, quite beautiful.
This can't be right. I was assured by many, many NCAA commercials that the real value of college athletics was the high-quality education and credentialing that scholar-athletes receive. Otherwise college sports would basically just be a taxpayer- and donation-subsidized minor-league system for professional sports leagues worth tens of billions of dollars.
And on the other hand, how can the NBA survive in this competitive world when virtually none of its new hires have completed their bachleor's degrees?!
Source: basketball-reference Draft Finder
Tool: R, ggplot2 package
I wish someone did aome analysis on this but I feel like this has led to people players taking long to develop.
I wonder what's the cause of this? Maybe developments in health allowing fitness to play a bigger part in ability?
I wonder what the correction on this will be. I get trying to find the next lebron/Kobe/KG but these 18/19 year old picks miss so often and players like kawi/draymond/curry fall so low. And real honest to god NBA players go undrafted like (van vleet comes to mind just because of the finals).
That's an incredibly disturbing trend to me. It suggests that there are a lot of players in the NBA today who have no college education and thus are totally screwed if they have a career ending injury.
Interesting but considering the current one and done philosophy over the finish school first this data is not surprising in the least.
Excellent. Fast & hard-hitting visual.
Can’t blame them. NBA making players play a year of college or overseas before getting the good money. Just making those NCAA bastards more money
Career scoring average and games played would be cool to compare the youngest of the draftees to older ones. I wonder if that extra year of coaching would be better for them
This makes a lot of sense. In the old days, being in school for multiple years meant you had a solid track record and was ready (not always as there were highschool draftees).
In the recent era, if you stay in school for multiple years - teams start wondering why and question your potential. So young guys who want to get drafted early and get paid would do the one and done.
Personal opinion of course, but all I see is a correlation between the average age of top (Lottery) picks and the the general decline of the actual quality and skill of the NBA player. The 80s and 90s NBA was far more entertaining than the NBA today.
This definitely shows some of the implications about how professional athletics organizations regard the post-career conditions of their players. This chart literally shows how the blacker the NBA got, the less they care about recruiting players after finishing college...
It's completely ruined the college game, which is a vastly superior product to the selfishness of the NBA. Greedy little bitches.
If anybody is wondering who the early reds are john williams in 1986 who had an ok careerhttps://en.m.wikipedia.org/wiki/John_Williams_(basketball,_born_1966)But the other one is Shawn Kemp 17th in 1989! (The Blake Griffin of the 90s)
Thank you for your Original Content, /u/mboop127!Here is some important information about this post:
This was made in Tableau using data from the Kaiser Foundation's 2017 demographics report and touched up in paint.net. I calculated over representation by multiplying the racial makeup in each state by that state's electors, and comparing those numbers to how many electors each racial group would recieve if electors were given according to popular vote alone.
The concentration of nonwhite voters in higher population states (which get proportionally fewer electors) means that nonwhite voters are under represented in the EC. A fuller explanation and link to the spreadsheet can be found here.
Thank you for your Original Content, /u/Animal_Companion!Here is some important information about this post:
Really inspirational. I am in a similar situation. I am 170cm and 85.3kgs (measured today).
Can you mention the pace of your walking?
I have an ACL injury so walking is the only cardio I can do currently.
Also how many cheat days did you have?
At the beginning of this year, I decided to lose some weight via calorie counting. Two days ago, I hit my goal weight, and made an infographic of all of my data.
Disclaimer: The energy intake values depicted in the infographic are extremely low. Replicate at your own risk. If in doubt, please seek advice from a medical professional.
Data collection details:
Did you take measurements of your hips or waist or anything during the 5 months?
It would be interesting to see what parts of the body lost the weight compared to other parts.
What would you change if you did it again? Maybe a little strength training have made a big difference in the muscle to fat ratio?
Congratulations! You have inspired me to do something similar with today having been day 1 for me. Weigh in this morning at 109.8 kgs and at 183cm that is far too much!
Hopefully with decent exercise and a much better diet I can head in a similar direction.
I just realized we have almost the exact same weight loss plan and height. The only difference is that I'm 21. How does it feel to lose 20 kg?
1000 calories deficit per day over 5 months. A pound of weight is roughly 3000 calories so that's about 1/3rd of a lb per day, over about 150 days. So 50 lbs lost just off of reducing calories.
Calories in, calories out. Math checks out.
Most people don't seem to realize that you don't need a lot of exercise to lose weight, you just need to eat less, or eat better. Cut out sugary drinks, switch some carbs to protein possibly, and just consume smaller quantities.
Crazy to think this amount of walking is actually average or below average in nyc. I regularly put in 8k per day. 10-16k if I’m running errands or out all day.
My Canadian self read this in pounds and wanted to call you crazy for thinking 90lbs is obese. Awesome job on the graphic OP!
Hello: Congrats on your plan and sticking to it.
I am wondering if you know what was different for you week 12?
Did you use any heart rate monitoring? I’ve always notice when I am trying to get into as good of shape as possible for things like grappling tournaments and doing a lot of cardio my resting heart rate tends to drop. It then raises a bit at my normal activity level
I am an avid gym goer. I weight train at least 5 days a week for the last 7-8 years. Never really taken many days off, and longest time out of the gym has been only 2 months because of a major home remodel. Over these years I never really watched what I ate besides getting enough protein in my diet to gain muscle. In this time I went from a 145 lb highscooler to now a 195 lb adult. I can forsure say that weight loss is 90-95% about diet and making sure you are in a calorie deficit for yourself.
4443 kJ/day? That feels hard, congrats! I can barely do 12500-13000. Luckily I'm pretty tall (193 cm and a bit over 90 kg) so I lose about 1kg per week as well.
If my math is correct, 4443kJ is 1100 kCal. Recommended input is ~2000
I feel like you starved yourself but if it works it works right?
I hope you stay at this weight!
Hey, that is a really good addition to this subreddit and and a good journey for you!
I appreciate you sharing as much as you did share with us. I would be very interested in a blood test / checkup of your values at a doctor to see the effects of this very efficient weight loss (also it could ensure a regular Vitamin intake I personally struggle with). Such a consultation and the blood test could be a pretty good stepping stone for others (without the thought of missing out / doing things wrong).
Any loose skin? My starting weight is about the same as yours, height is 175cm, I'm shooting for 70kg and my wife says I'm probably gonna have loose skin.
Interesting stats and you've looked in to it a fair bit. Well done on the loss man and keep it up.
Is it just walking that you have done? No other gym exercise or anything? Also what is your eating pattern like during this time and what is your daily activity - job/school etc?
Can you please convert this into a more understandable American format?Cheeseburgers by bald eagles or guns per lard will be acceptable.Thank you
Well done. I'd be interested in your food diary. Mine is currently set to daily goal of 1650 and not really losing any weight. I don't have breakfast and a sandwich for lunch is easily 500 calories, which would be half my allowance!
However, I do 8k+ steps and go spinning once a week (trying to push to twice).
Unfortunately the weight loss has taken a backseat as I am on holiday at an all inclusive resort. Will go back to it on Thursday!
I think you’re R2 value would be much better for your BMR activity factor variance analysis if you removed the 2 outliers. Nice work!!
In bodybuilding most people say, one should loose 0.5 kg per week an start to eat 500 kcal less, than the daily need. As you mentioned eating only the half of you daily need is very low. But anyway good job op! :)
I love all this data. I hate BMI for its generic, one-size-fits-all format. Nice work to OP for tracking and mapping it.
Great demonstration of weight loss being primarily about calories, OP.
I'm generally a OMAD person but I've been making this pizza recipe that's fairly balanced nutritionally that people counting calories trying to lose weight might be interested in.
454g lukewarm water11g sugar 11g active dry yeast 11g salt 25g olive oil620g King Arthur 100g ground flaxseed
Knead it a bunch (stand mixer ideal) and it can sit in the fridge for a solid 4 days (gone longer but it gets sour-dough-y). Based off this recipe (just added flax). +2 cups of moz and 25 slices of pepperoni comes out to ~1300 calories. I've been doing one of those and a protein shake + lifting some weights during the work day casually to lose weight...fairly well under my TDEE (not as extreme as OP though). Down almost 15 lbs in ~2 months (started as 6'3" 225 lbs though).
Breaks down at a glance to (per ~300 gram pizza w/ toppings, recipe makes 4 pizzas):
Protein: 31% 419 kcalFat: 26% 353 kcalCarbohydrates: 42% 561 kcal
...and you get to eat pizza and lose weight. Ideal, for me at least.
Quick edit but once I get sub 200 lbs again I plan to eat two pizzas and a protein shake a day and see what happens.
ok, so you ate less than half of your energy output for 4 months.
that kind of thing would certainly lead to a weight loss... but i am not sure how much of it comes from decreasing muscle and how much was fat.
I dont know why but all I saw was Ferrari technicians working on a Ferrari being like " Mentre la macchina è sempre bella, sarebbe meglio se potessimo ottenere una riduzione di peso."
Good job though I want to lose weight.
First off, congratulations. Good job. I'm tryna lose weight as well. Just by diet and probably 6k steps on weekdays. I really dunno how much weight I've lost. But people tell me you've become a little thin, which makes me happy. I really hope whats happening is a fat loss and not a weight loss.
Wow that's an amazing achievement! I went from 87 — 66ish and its taken me over a year and a shit load of running at the crack of dawn. To lose that much in that space of time is incredible!
Nice charts. In the last charts though, if you would remove the two outliers to the right, all the other data seems to show a much better correlation. Could it be that those two points have some error/randomness to them?
Give us some details on your diet. I'm a female and walk an average of 10k steps a day, I've put on some weight in the last few months and been having trouble getting it off... It'd be great to know what you were eating.
What did your diet consist of in the real of caloric intake? Did you simple us ACIAC or a more specific diet program?
So you were eating 1000 calories a day? What the fuck?
I’m already in decent shape (27, M, 167cm, 134lbs) but I’m trying to lose a few lbs for athletic reasons and I’ve found myself being completely fatigued from hunger if I dip under 1800.
I've been trying to lose weight this year, but I've hit a hard plateau of around 165 lbs. Any tips to break through?
Thats very impressive in 5 months, good job.
I wonder, how many calories were you eating on avg? Because i used to weigh 95kg, then i started eating about 1500 calories and it took like 1.5 year for me to drop down to 67kg, i was excercising couple times a week. I wonder if i maybe have hypothyroidism, feels like it shouldve gone down faster, and i have other symptoms.
You ended up around me. That's amazing. Im 5'7 and 60.3 kg. Hate that people always pick on me on how skinny i am.
Im 170cm aswel but i got a complete opposite problem. I just cant get myself to eat it becomes physicaly impossible to swallow food.
That is like one of the best post I have seen here.It's informative, clear, eye-catching and not cluttered.
Bravo. You deserve all the upvotes.
Congratulations! I've been trying this for a while, but i only have a bit of a chubby belly, i am not obese at all. It's difficult.
This is fantastic. Your starting point is my end goal!
I started at 320lbs and am down to 288.1 as of today!
Thanks for the motivation, the long term chart is very encouraging!
Meanwhile I'm one of those persons who needs to gain weight. And u know what? Zero help, Zero info, zero anything. Aren't there people out there who are underweight like me? I've been trying to gain weight the last 2 years. I weigh 50 kgs approx. And I'm 1.75 long. I've always been on the lighter side but I'm too light now. Anyone knows how to GAIN weight? Oh and don't see " eat more ". It really isn't that simple. I'm even putting my life on the line when I say it's harder to gain weight than lose it. In a state where you want to than. Not some normal weight guy suddenly eating twice the calories. I'm talking someone who has been underweight that wants to gain.
This is awesome. I tried to track all of this, but found myself getting in my own head and tripping up, so the only way I measure my progress now is the mirror and photos. Posting this on the chance that someone else finds themselves in a similar situation.
Any tricks to eat less? I always fall off the wagon 😭😭
Nice job losing that weight!
Rather than micromanage my food intake, I have always preferred exercise. Figure if I don't change anything about my eating habits but exercise enough to burn 500-1000 calories a day, then I'm doing good.
I walk 4-10 miles a day depending on how much time I have and I take a minute or two every couple hours to do some pushups/pullups/planks/dips/squats or whatever exercise I can do wherever I happen to be.
I’m 185cm and at the start of Feb (after getting back from a food based trip to the US) was at 93kg. Currently I’m 86kg and aiming for 78-80, so half way there! Thanks for inspiring me to keep going!
Woahhh I'm 178cm & ≈84kg & try to lose weight too!Currently 10000 steps daily for 11 days this month already :D
I cannot understand these measurements. OP, please translate these strange numbers into cheeseburgers per heart attack, so everyone can understand!
Good on you!
Calories in, calories out. It's not that complicated unless you're looking for a loophole to eat ice cream.
I'm at 17 bmi, I'm trying my best to gain weight but it's hard.
Hopefully one day I'll be able to post a reverse graph like this.
That is awesome! Thank you for sharing this with us. :)
Wish all I had to do was walk. I pretty much cannot have calories unless I'm doing high intensity if I want to lose those 5 or 10 pounds. Auugghh.... you're not a female, are you?
Thank you for your post. I really liked it. I'm in a similar position (~85kg 169cm) so it's also an inspiration. You mentioned that it's 90%+ eating and I agree. I was able to lose 8kg over two months and food intake was a big factor. It'd be really informative if there was some information about food intake as well but I know that this is much harder to measure.
Congratulations on your weight loss and wish you the best in maintaining the weight (no sarcasm intended).
I had a goal of losing wight down to 80 kg when I started working out. But according to my doctor I would still be weighing 90 kg with 0% body fat. So I had to change my goals.
you're not losing ~five pounds at week 16 being ~145lbs while eating a DAMN thing, its just not possible.
How are you planning to keep this up?
Because weight loss could be seen as the easy part, the hard part is not to fall back into unhealthy habits.
(I once lost half a stone deliberately to see how easy it was. I'm already at the lower end of BMI anyway, but was curious. I did it through not having dinner for a month and not snacking.)
Best of luck anyways!
Please stay at your actual eating and sport habits. Or at least don't fall back on your old habits and develop new habits, that help you to stay at your desires weight! So you can avoid the JoJo-effect.
You're doing really well and you're graphs nice but to make a picky point (as you're starting to get a bit scientific) weight is measured in Newtons while mass is measured in kg.
While this is a wonderful start, your average kJ intake per day works out to 1051 calories (?). Can't help but wondering how much you were eating before this and if such a sudden calorie deficit didn't drastically affect your lean body mass.
Great data, but one comment: If you're getting an R2 of 0.0077 I'm not sure it's worth fitting that line as it implies there's almost no correlation between that model and the variance of your data
Thank you for your Original Content, /u/trevorData!Here is some important information about this post:
7 days seems like a fairly quick response time. It's impressive how much gets fixed throughout the year just in time for winter to fuck it all up again.
I bet the map for Peoria is just one big red square all year. Seriously you can't fix a pot hole if the whole road is a pot hole.
Finally some data to validate my anger! West Town is an absolute widowmaker for rims.
I've hit potholes there so big and hard that my soul leaves my body for a moment and I audibly apologize to my car.
I am actually impressed that it looks like an even distribution. The cynic in me just assumed the nice neighborhoods were serviced first.
Looks like the image previewer is cutting off the end of the gif, so if you are having trouble viewing, please use the direct link
I'm surprised that there are so many potholes. I've seen that in Italy, Greece or India, but in no other European country. What makes this so common?
Jaguar is working on a system where cars report pot holes over IOTA network, so that drivers get paid in microtransactions for their cars reporting potholes.
Pothole condition of Roads in India
* Including NH & SH Roads.
* Based on data as of June 2019.
* The area marked in grey are the exact location of potholes.
So there seems to be a very strong correlation with winter. So why do the roads in Hawaii suck so bad?
I wanna see one of these for Guildford UK, but I get the feeling its just gonna be a constant red blob.
Seems like Chi has a good system in place that others could benefit from picking up on. Curious to see how the winter months bring it back down as time goes on, however
I see a block on this map not too far from where i used to live, and i can tell it is probably not entirely accurate. That block was the center of many trucking and industrial yards, and the roads there were the worst out of anywhere else in the city that I know of. You had to drive 15mph down side streets just because the road was so bad. Either this map is based on reported potholes thru the 311 number and for some reason the truck drivers and workers at the factories never reported it, or this map is innacurate.
The only aspect of this that bothers me is the denominator, labeled km^2. Wouldn't frequency per km of road give a cleaner perspective? Or does km^2 refer to the whole surface area of road (in which case, nevermind this question)?
Who is destroying the roads every January? The city keeps fixing them but at the start of every year some random dude destroys all their hard work! /s
Well they were doing a good job until they let them all come back, seems like they're making it a cycle on purpose to waste tax money. r/sarcasm
I have a hard time trusting this data because I’ve had intimate relationships with several of the same unpatched potholes in the city for years.
When the gif replayed itself I thought they suddenly got a boatload more potholes at the beginning of the year until I checked the time
All of our 'potholes' get fixed almost instantly by a response team. Most I've seen is a day. Saw in a list we have some of the best roads in the world. Little space, lot of people, guess we don't have a different option. Greetings from The Netherlands.
What's with the seasonal change? You guys have hibernating potholes or something? Was there a major earthquake that year?
You should see the state of some of the roads in the United Kingdom. Years of austerity have ruined our roads!
I’ve noticed that pothole appears after snowplows have cleared a road. I think that the snow and ice “grabs” the pavement and pulls out chunks when the plow goes by.
By fix do you mean just put a big metal plate over the pot hole? Come over to Portage park for a demonstration
In some places, I've noticed that potholes emerge where there is more acceleration in one spot over time. For example, stop lights or signs where traffic idles and then pushes against the ground in the same general area. Think of a cartoon where the character runs in place for a moment and generates high abrasion in one spot: https://www.youtube.com/watch?v=Fbcu6upPKrY
I wonder if there is a way to pave these types of "high pressure" areas differently with a more sturdy, albeit more expensive, material to counter this acceleration effect. The parts of road where traffic is expected to always be moving would have less risk of wearing out over time.
I'm a bot, bleep, bloop. Someone has linked to this thread from another place on reddit:
If you follow any of the above links, please respect the rules of reddit and don't vote in the other threads. (Info / Contact)
The entire island of St Croix would be one big red blob, year round. Our potholes could eat a small car, lol.
I wonder if something like this exists for Michigan?
Probably not, the whole state nearly would be a red dot.
The maintenance crew must be masochists, to work so hard only to watch it fall apart again in a few months.
Still not as much as the immediate Kansas City metro area. Swear to god there’s more actual potholes than street in this damn city. 🙄🙄
Who the fuck tracks potholes this extensively!? It seems like fixing them would take a hell of a lot less work. 🤔
Just moved to Chicago. Some people told me that the city workers do a crappy job on purpose so they can go back and do the work again. Job security paid by tax payers i guess
Use the roadway materials they use in germany and this wouldn't happen.
Gotta keep the crooked unions pockets full. That lobby money is nice.
The Chicago Department of Transportation (CDOT) oversees the patching of potholes on over 4,000 miles of arterial and residential streets in Chicago. CDOT receives reports of potholes through the 311 call center and uses a computerized mapping and tracking system to identify pothole locations and efficiently schedule crews. One call to 311 can generate multiple pothole repairs. When a crew arrives to repair a 311 pothole, it fills all the other potholes within the block. Pothole repairs are generally completed within 7 days from the first report of a pothole to 311. Weather conditions, particularly frigid temps and precipitation, influence how long a repair takes. On days when weather is cooperative and there is no precipitation, crews can fill several thousand potholes.
Data depicted is for the year 2014 (chosen because it had the most potholes of the available data)
Pothole Data and Shapefile downloaded from Chicago Data Portal
Data manipulation and visualization done in R using the following packages:
Gif made with ezgif.com
View my code and see individual frames at github.com/trevorData/Pothole
Thank you for your Original Content, /u/tootsaysthetrain!Here is some important information about this post:
I've used Lost Circles myself on facebook, it is extremely interesting. My biggest groups were my home city, my university city, and extended family. The most interesting part was seeing the connections between them that I had never expected. It turned out some people I play sports at uni with happen to be friends with people I used to live near at home! It's so weird, everyone is so connected
When I think of data is beautiful. This is the exact kind of post I imagine. Thank you for this OP.
EDIT: Wow, thanks for the platinum....... and four gold, three awesome original content and four silver! I'm very flattered, I'll just go ahead and retire and move to a distant paradise island on some subreddit now. Much love kind redditor strangers!
EDIT 4: LOOKING FOR ANYONE WITH PYTHON CODE SKILLS! Since this post got a lot of traction, I got keen on doing a similar visualisation with the amount of messages exchanged between me and my facebook friends. If anyone is good at coding with python and would be up to help getting the data. I would love to to a follow up post! I found this article that makes the scraping more effective since we're talking about thousands of messages.
If any moderator is reading this comment, please pin it to the top. If not, dear redditor, please upvote this comment so that people that want to create their own graphic can see the instructions
Try this at home, but proceed with care (risk of temporary Facebook block)
Several people have told me that they get temporarily blocked on Facebook after trying to use Lost circles saying something that they use up too much traffic. There's nothing illegal about getting the data, but please proceed with care. There might be a solution to this, although this is just a hypothesis. The problem seems to be restricted to americans, this might be because of Facebook's geographically centred precautions for bots / fake news.
Also try checking out this youtube tutorial. The guy in the video doesn't use Lost Circles to scrape the data, but he describes how to process it in Gephi.
Solution: Try using a VPN, set it to somewhere in Europe and see if the problem disappears. If the problem is still there, try uninstalling the add-on and see if you can access your friends again.
EDIT 3: From your amazing input and kind words, I decided to present an UPDATED VERSION. I've taken some different things in consideration about the layout of the legend and decided to not sort them after how big of a portion they make out, but rather how easy it is to read as well as sizing up the labels a bit and making the text uppercase. The graph is about soft data and getting a feeling about information rather than quantifying it.
Since I have gotten some requests of the pure visualisation itself without the legend....HERE IS THE CLEAN VISUAL
I hope you enjoy!
So I’m not usually a statistics junkie and this is my first post here, I hope you enjoy! It was really fun to create this infographic and also eye-opening to get an understanding of how I’m connected to my friends, but mostly how they are connected to each other.
Source: The data is scraped from Facebook using the free chrome add-on Lost Circles and derives from my friends and the mutual friends each and everyone have with the friends of mine. It took about an hour to scrape all the data. The names of the people got a bit messed up as I could only save the file as a .JSON or .graphml file instead of the preferred format .gdf which is not shown in the picture anyway, but made it a bit harder to define who is who.
Tools: It is then processed using Gephi (also free software) to visualise the data. Although a rookie, the graph is generated through an edited Forced Atlas algorithm. The color code is defined by using a modularity class to group the different friends together. The distance between the groups of friends is defined by the amount of intermediate connections between the different groups of friends.
I also tried to run an average degree to increase the size of the nodes of the friends that are mostly connected without succeeding. But then I also thought that it wouldn't make any sense to show which person is most connected for the sake of the format that I'm posting here, where you can't zoom in and see who that person is.
Lastly, the graphics is edited in illustrator to make it more easily interpreted and adding the labels and the written statistics of the groups. A tip if you want to edit the nodes in illustrator and you're not that experienced (thickness of the nodes, colors, et.c) is to use Select > Same > Fill / stroke.
Input: If anyone is experienced in using Gephi, I would love to hear if there is any possibility to add pictures to the nodes as well as moving groups of people manually, instead of solely relying on the algorithm. Lost circles own visualisation tool offers pictures, but the representation is messy, can't group people and is laggy overall when you try to move individuals. Also, another thing is if there is any possibility to get the correct names of the individuals, I now see the links to their facebook profiles instead.
I won't post the raw data for integrity reasons.
Happy to hear your thoughts and feedback, as well as answering any questions if you have any!
This is awesome OP! I actually recently mapped connections between all my friends since college. I can see similarities:https://m.imgur.com/gallery/LOSr9
Edit: Aww, thanks for the gold!Edit 2: A second gold?! Guys, stop. My joke was awful.
I saw “Stockholm Miscellaneous”, assumed the syndrome and not the city, and wondered how terrible a childhood you had.
This is begging to be turned into an album cover:
“Relations - Self Titled”
My first thought at the title "relations" was that this was a graph of your sexual partners. I was quite impressed/horrified.
I'm kind of amazed at how separated your MA program was from all the other groups. Did you go to a unique or unusual school after your BA?
I tried Lost Circles and a few seconds into the scraping, Facebook told me that I was "blocked from using this feature" because I was "too fast". So this extension cannot be used. Any idea/recommendation?
Is it just me or does anyone else see a pattern that almost reflects a human body.
Edit: Well done OP, especially for someone that describes themselves as a newbie. I know people experienced in visualisations that have never made something this good.
So apparently it is true that people stop making friends after college...
(Though strangely that has not been my experience, which may be an advantage of being single in my late 20s)
This graph is gorgeous. To someone like me who values friendships more than anything else this is like visualizing the meaning of life. Thank you for sharing this
This is fantastic. Looks like some kind of futuristic cyberpunk jellyfish.
Also, you should post this to r/DataArt, they'd really dig this over there!
How do you have so many friends, or are these just people in your facebook friends list? You can't possibly remember all these people, is data fed through facebook/twitter/linkedin connections or something?
I wondered why workplace friendships were not represented, and then saw you used Facebook for your data source. Is this a causal relationship?
Especially for military folks, their work life shapes everything from where they live to how long, as well as who is accessible and what kind of community they live in (barracks, base, overseas)
How stoked would you have been if one of those people from your Transatlantic trip somehow, by some miracle, linked back to another one of your associates?
What the fuck, visuals are getting insane for data. Like seriously, one of the most beautiful and intuitive visuals I have seen to date. Fucking, GPU to the extreme
Anyone a teacher thinking about how to use this in their classroom? I teach technical communication at a university in the US and I've been experimenting with data visualization for a while. This could be a good tool for projects like mine.
This kinda makes me feel like shit.. considering i had basically 0 friends in college, highschool, and my childhood.. maybe 2 friends at most... it seems like it only gets significantly harder outside of those 3 stages of life.. damn.. FML!
When I read "stocholm" I instantly wondered if you were kidnapped and now you have a really fucked up friendship
Someone’s got a lot of friends! If this were visually represented for me it would probably be 5 or so dots
You know i would be really interested in the degree distribution of this. It's probably a scale-free network but that's just an educated guess.
You can almost visualize the butterfly effect. Imagine if just one of these relationships changed it would cascade into the future, maybe your mom never met your dad or the sperm next to you becomes their new baby, and the genetic code that would have became "you" is dripping out of your moms vagina post-coitus.
This is beautiful! I’m just starting to learn data visualization and I’d love to produce something like this.
Interesting. So you haven't moved out of your home town, at least until recently? Funny that in my case I (and my friends) would have massively more contacts from Masters times than any other group.
This is great. I'm keen to have a go at creating something similar for my own group of friends, if I can figure out how!
Edit for questions and observations: I find it surprising that apart form a couple of exceptions there aren't that many close links between your 3 uni groups. I assume that your family fall into the childhood section?
Incredibly cool. I just got back from my college reunion and, despite having gone to a pretty large school, it was crazy seeing how many people that I knew in completely different contexts (friends from my freshman dorm, colleagues from my work study jobs, friends from class, friends from my major) actually knew each other (some of whom even met after we graduated by moving to the same cities or meeting through alumni networks). I'd love to see a visualization like this of just my contacts from school color coded by how I knew them.
This is my favorite thing to explore, finding the random connections people you connect with have with other people you connect with
A question from a noob who just likes to look at pretty pictures. Is there a point in having the data visualization for the high school group separated out like that? Or for the groups themselves separated into that specific order? Is it a product of the visualizer or something else?
I had to look up that "Kith and kin" meant. Thought it was a band or Bible study group.
kith and kin. Friends and family, as in Everyone was invited, kith and kin as well as distant acquaintances. This expression dates from the 1300s and originally meant “countrymen” (kith meant “one's native land”) and “family members.”
I work in the design industry which is a lot less formal I would assume. I hung out with my colleagues and saw them as friends. They made up a considerable portion of “Stockholm miscellaneous” and I decided to put them in the same group as the people I got to know in Stockholm that wasn’t from BA uni or were friends with BA uni people. That’s why the Stockholm group is so small.
Wow. I want it.
But as of now it would kinda be just one spot.. More realistically a starfish with a rectangle or so, but pretty boring stuff :D
If Keith and Kim make up 5% then he’s got 40 friends.
If I’m doing the math right, that’s about 100 friends more than what I have.
Cool but where's Kevin Bacon fit into this
It makes me wonder if the people who seem to be key due to their connection in your life events are also pivotal people in your life? For example the person in the centre linking alot of ba university campus with BA University course and also has links to your high school and childhood. Can you recall who this is and have they impacted your life more than others?
I apologize if this has been asked elsewhere, but do you think exporting your Facebook data would have the same effect (without risking a temporary ban from the platform by using Lost Circles)? They make it pretty way to get an archive of all your data, including things like connections.
Did you categorize these friends yourself OP? If so this data would be really useful for testing my community detection algorithm. I’ve had a hard time finding good datasets with ground truth communities.
Very cool graph, it's almost an art piece in itself. Reading the statistics does make me a bit sad though. As someone who didn't care for his childhood or the people in it, and didn't do college, I really only draw from the Highschool category, which does seem accurate for the people I'm close to now. Sucks to have missed out on things like childhood friends though.
So confused how it can configure interconnections if that data isn’t even present. I’ll give it a go again and see what I can figure out. Thanks for the quick response!
The center of the big purple blob up top is my friend John Stewart.
/Not the TV show host. Probably the one you know.
Can someone explain why the red is lower to the ground and green and blue are higher up? I would think that only the size of the cluster matters, not the height/position.
I remember when LinkedIn used to have a tool that did this for your business connections. I actually discovered a few people that crossed friend/work groups that I didn't know were connected.
let me get this straight. each dot is a person and each line represents some kind of relationship so this graph shows how suprisingly connected your friend groups are?
How come you had 4 friends that connect to a lot of people of your childhood, but don't know each other? :o (nodes on top)
I checked Gephi and those are nothing specific. I got surprised myself. I think it’s just a bug in the algorithm that distributed the nodes.
They are in fact equally connected. Every in relation has an out relation, so even though it looks like they’re not connected, they are. Do you see what I mean?
Hey, I am trying to use Lost Circles to try my hand at making something like this, but the links field in the json, that is basically the links between my friends comes up empty. Any idea why that is happening?
You made more friends on your transatlantic trip than I have in my entire life. I'm 36
This data is truly deserving of the title “beautiful”. Well done OP!
Physics and chemistry gave us the interconnected stars of the universe. Then biology gave us the interconnected neurons of a brain. And after that, culture gave us the interconnected people of society. The pattern keeps repeating. Maybe we will see it repeated again...?
This is art. Can we have a high res picture without the legend?
And for those of you who argue uniqueness and individuality over mob mentality and group-think, here is your scientific proof that you are dumb.
Damn, the colors look really nice. It’s neat to see how distinct certain friend groups are from each other.
Thank you for your Original Content, /u/pamorgos!Here is some important information about this post:
Visual made with http://sankeymatic.com/build/
I'm surprised your taxes are only ~25% of your income. They're much much higher for me in the US. I'm also surprised your health care costs are very similar to the US. I thought we were the absolute worst on that.
Nice breakdown.. where do you live in Bavaria? I spent some time living in Munich and housing over there is just crazy. 520x2 for two of you seems legit..
Made with Love in New York City, New Jersey & Monterrey, Mexico.