a cura di Enrico Fedocci
Do they need quoting? Do they have multiline string entries? You say the notebook you want to use for that is not powerful enough to experiment too much. What is the environment you would prefer to use? For example, what is the operating system? How large or how complex to install are the extra tools allowed to be? Are there some tools installed that you would actually prefer to use, so that it would be simpler for you to understand the complete solution? But this is the simplest case possible, and approximately the most corner-cutting solution possible.
The main table contains , entries, with 13 columns apiece. There are three other tables that modify or add columns, and three others that allow the renaming of certain values. There is a simple uniquely identifier for each entry, spanning all of these tables. As long as it stays within a Windows-based ecosytem, I should be able to get it into Excel where I do all my analysis. I might not have the technical chops to answer this appropriately.
My notebook is an Asus that I bought at Best Buy in an emergency and it gags on this dataset. I am only familiar with Windows. Functionality is number one. Long time lurker, registered to come out of the woodwork because this seems to be an interesting problem. It sounds like all of your analysis happens within Excel, so I suspect that a database might just end up adding unneeded complexity. Instead, you probably just need something to merge all of these CSV files into a single file format Excel can handle probably also CSV for simpler code handling, but I digress.
Could you provide examples or, if more practical, the actual files? And the laptop would brick itself. I suppose a VBA could do that more efficiently, but I am definitely below the VBA level, other than creating simple mathematical functions. This link will download a. With data like this, it might be more straightforward to go with a real DB MariaDB, perhaps and get someone to give you an appropriate SQL query or view.
I recently merged about csv files each with about k lines each into one csv file using R and I still have the code for that. If you are willing to do R I could give that to you. Could you give more detail of the exact problem? Is this for football statistics by any chance multiple updates in the fall seems to fit. R has been on my list for a while now! Just not enough mental overhead to learn how to use it. If you have any recommendations about how to get started, I am all ears.
It is indeed football statistics. I have some data from SportSource Analytics, and an analytic method I want to refine. You can download R Studio here https: This is a good starting reference. And do something similar for the other files. You can make a batch file to do something like this automatically, if you get tired of typing the commands. To do so, make a file called something. Just open excel and open the CSV files.
Having other tables that affect the main table sounds pretty weird to me, as well. If you combine enough of these files, you may run into that.
I know this because I had a dataset of about 18,, lines in CSV format, and I had to come up with methods to reduce those so I could work with it in Excel. I ended up learning some Python, because it has easy CSV support. Ooh, if you want an Excel-based solution, then this seems up my alley. This is Excel-VBA code that will hopefully dump the contents of all. It assumes that all csvs are CRLF-terminated which they should be if they were produced from Windows. You should get a blank white editor pane in the main window.
Copy-paste something like the following:. This may leave residual rows and columns around if you ever decrease the total number of ids or the total number of columns. If you're about to do that, then first delete the entire contents of the target sheet.
Next i End If Wend Close fd. Keys i Next hdr. Um, hopefully that worked. This is me trying again. You mention two problems: It is a little odd that analyzing the data is not, apparently, slow, but importing it is. People seem to be focusing on automating the merge. This is important, but they seem to be ignoring the computational bottleneck, and that should be examined. Do you mean converting a csv into an xls, or do you mean merging a bunch of tables into one?
If it is the merging process that is slow, that could be done an external program. It would probably be very easy to write such a program, and a commenter would probably do it for free. But if the problem is converting it from csv to xls, then that is probably a more difficult problem. But maybe you could live with telling excel to import and walking away while it works. Once I can merge the data, and can pull a subset out of the data, moving it into my analysis worksheet for output should be pretty trivial.
Anyone who has done a moderate amount of technical consulting in the generic, informal sense of that term has faced the problem of balance between the best approach from a technical standpoint, and the expectations of the consultee. He has specifically expressed hope that he might understand the solution enough to modify it. People are trying to respond in that spirit. Given that the data in the zip archive is relational, and there are many tables, it would probably be most straightforward to do the translation with SQL, for two reasons.
You just import the CSVs, add a few indexes, and then run a query, the output of which could be directed to a file for import in to Excel. In two of those years, our team was in the top two teams in Massachusetts, thanks in large part to my work in computer vision and motion control algorithms. Using Python, I have done research into the visibility of solar transits in ultraviolet wavelengths to investigate its usage in discovering exoplanets.
I have also taught introductory and intermediate Python to high schoolers and middle schoolers to get them interested in becoming the next generation of computer programmers. I post on SSC and the rest of the rationalist diaspora fairly frequently using a different account.
I did not want to associate the two names too obviously. Can you email me with a linked-in invitation? I can see your profile, but not your contact info. It even doubles as a videographer. I originally built this for my own wedding and it was a hit with the guests.
Proof of concept video: That was when the design was much more primitive. If some but not all are accurate descriptors, how many are sufficient? My wife and I have wanted to do this sort of thing for years! Requested group membership — would love to hear more. For pure development gigs per-task bounties broken into well defined criteria help align incentives. My friend Ella, with whom I share a writing blog , posted updates in the last two classified threads about the books we were planning to self-publish.
My book, The Sign of the Sibyl , is an epic fantasy that combines academic politics, cut-throat political intrigue, the tension between science and magic, and age-old prophecies of the end of the world natch! The story follows two young scholars from 17th-century Cambridge, acquaintances of Isaac Newton, who travel by magic to a parallel world that bears striking similarities to the Roman Empire—and to the Atlantis of legend. You can read more on our blog with a link to a PDF of the first chapter or find it on Amazon.
Set in Mendacia, a fictional Central European country whose ethos is part Medieval, part Byzantine, and part Victorian, the story centers around seven girls. The girls face poisoning, kidnapping, and brigands, trying all the while to stay one step ahead of the murderer, irritate the Greek prince who is supposed to marry the princess, and of course try to figure out which one—or how many—of them is actually of royal blood.
Again, you can read more on our blog , which has a link to the first chapter, or find the book on Amazon. I looked through the sample chapter of your book and I found it fairly entertaining. Throughout, it will remain free for subscribers to the Kindle Unlimited program, as well as to those who borrow it from their friends via the Kindle Owners Lending Library. I recently moved to the Seattle area, making me possibly the first rationalist to move to Seattle from Berkeley. What do you like to do here besides the Monday reading group?
They hire quite a few with your background, and you may feel right at home next to the airforce base. Thanks for the rec. I am available for off-site work, as well as for on-site work in most of Manhattan and some of Brooklyn, Queens and New Jersey.
My negotiable rates are: Payment is due net 7, with the first payment due prior to commencing. I will accept partial payment in Bitcoin, Ethereum and Litecoin. I am a strategic and thoughtful communicator who responds to customer e-mails rapidly during business hours. I become available for additional work late next week. My company is looking for programmers and system administrators. We are based in Canada and develop software for hotels; all our engineers work from home.
If you are able to work on Mountain Standard Time time or within a 3 to 5 hours of MST we are interested in talking to you.
If you feel you have this knack regardless of credentials and are interested in working from home, please contact us at https: Will this give me added cred, or will this just confuse the person who is checking the email? I wanted to be able to explain what I did.
Now my son knows I make Algorithms, Debug, and shave yaks. Just like you should be careful about how you spend your weirdness points, you should also be careful about making your children have to spend them.
Telling a child about yak shaving is a sure-fire way to make him run out of weirdness points when he inevitably talks about it in front of someone else. You might know me from the AI-assisted translation of Genesis 1 Scott posted. A few years back, I self-published a book about artificial creativity from long before the invention of computers.
It begins with the divination systems of prehistoric Africa, which followed mathematical principles to generate unique utterances in response to the questions of petitioners. Tracing the influence of philosophers and artists, inventors and scientists, musicians and mystics, it goes on to explore machines that, before the dawn of the twentieth century, were designed to write poetry, compose new melodies, understand language, prove theorems, and create artwork.
It concludes with an examination of the current and future prospects for someday building a machine that can truly be called creative. Any other rationalist folks out in Hawaii? I made an Android party game called Word Nazi. Thu Sep 14 I love how many app developers respond obsequiously to their low-rating reviews, but you respond with:. I am looking for a web developer with social-platform building experience to join a nascent startup as a full partner.
NYC Metro area preferred. Please contact at Barryjnewmark gmail. Subject matter is almost entirely distinct from the SSC subject matter, but maybe a few people will like it, so hey why not. Linking to it here. Thanks — that was one of the things I was hoping to get from this. Never enough to just write without reading. I have a BS in psychology and experience both as a mental health counselor and medical scribe. Boston area preferred but certainly not required.
I can be contacted at thomas. Need advice on a software issue? The Greenfield Guild can help you steer in the right direction, regardless of what that direction is. Initial web consults up to 60 minutes are free. I also need to find people familiar with selling into the IT consulting space; if you or someone you know does that, please reach out temujin9[at]greenfieldguild[dot]com.
If you are thinking along the role of helmsman or autopilot? I dunno, just thought from the skillset. Are you by chance versed in user interface design, too? The intent is to network and build a good reputation, not just drum up clients. What do you think of this? The Greenfield Guild is glad to assist, whether you need a full team to tackle your project, or just a little advice.
The initial video consultation is always free: To answer the other question: Looking for work in the people side of tech or finance sales, renewals, etc in the Pittsburgh area. I have relevant experience in EU Lobbying and Business Association work, although it was a couple years ago.
My studies are currently focused on armed conflicts, but i also had my share of basic econ, philosophy. Have done a little statistics work before, but would need some time to get back into it for anything more complicated than a correlation. I am basically willing to move anywhere. I would be grateful for any input on how to build my career but especially pointers to concrete opportunities.
Are you interested in AI risk? I understand a lot of AI risk strategy groups are looking for political science people to help understand the dynamics of potential AI arms races? I can try to get you in touch with them if you want. I have been studying neuroscience for years and just finished writing a book about how the neocortex works. It is meant to be readable by anyone. I hope some of you would find it interesting. If anyone likes it and wants a paper version, I will have some in Berkeley in a couple of weeks and on Amazon in a month or so.
I especially have a soft spot for Russian literature. Tell me about the weird movie you just saw! Tell me your latest favorite song and teach me the words so I can sing along way too loudly! Email me, lordpoochie at gmail and we can exchange pics. Steam, Oculus, and gmail accounts are the same name. I suck at marketing. If you want to work on various projects to build skills and turn a profit, please come join us in the links below.
The above links will always go to the most recent version of the game, and I intend to update it quite a bit over the next day or so, as people find more problems with the game that my playtesting crew missed.
If you have any questions about the mechanics, or if you find any bugs, please write me at Theodidactus gmail. I am probably also too late, but whatever. It would be great to find a study buddy.
Obviously interested in rationality and stuff like that. Well, I hope for maths you do know about IUM existence… although that only works if you want to study maths quickly enough. And I guess has some availability for new patients. Insurance network not terribly important. Going to post a link to my Agora project again.
Basically, a new kind of Internet forum aimed at solving online discussion. Though I need a lot more data and a lot more work to get there, of course.
Recently, I just compiled lots of stuff from into an instrumental rationality book. You might find it interesting. Hey scott, I was thinking of putting together a toot bot for you on mastodon. Does that sound like something you would be okay with? No promises about actually doing it, though.
Triplebyte is building an objective and empirically validated software engineering recruitment process. We invite you to test your skills and try our process! Nectome is building the first brain preservation technique to verifiably preserve your memories for the future.
We start with a presentation of a summary of the article, and then discuss in a friendly atmosphere. Altruisto is a browser extension so that when you shop online, a portion of the money you pay goes to effective charities no extra cost to you. Just install an extension and when you buy something, people in poverty will get medicines, bed nets, or financial aid. Metaculus is a platform for generating crowd-sourced predictions about the future, especially science and technology.
If you're interested in testing yourself and contributing to their project, check out their questions page. Beeminder's an evidence-based willpower augmention tool that collects quantifiable data about your life, then helps you organize it into commitment mechanisms so you can keep resolutions.
They've also got a blog about what they're doing here. The Effective Altruism newsletter provides monthly updates on the highest-impact ways to do good and help others.
Jane Street is a quantitative trading firm with a focus on technology and collaborative problem solving. We're always hiring talented programmers, traders, and researchers and have internships and fulltime positions in New York, London, and Hong Kong. No background in finance required. Their free career guide show you how to choose a career that's fulfilling and maximises your contribution to solving the world's most pressing problems.
Support this blog by donating through Patreon. Giving What We Can is a charitable movement promoting giving some of your money to the developing world or other worthy causes.
If you're interested in this, consider taking their Pledge as a formal and public declaration of intent. MealSquares is a "nutritionally complete" food that contains a balanced diet worth of nutrients in a few tasty easily measurable units.
This entry was posted in Uncategorized and tagged classified. Semper Classifiedelis wearsshoes says: September 13, at 9: September 13, at Everything can get creepy fast… Literal Genie staisfaction of constraints can ruin everything. September 14, at Educational materials is a good one, thank you! September 14, at 6: September 21, at 6: These days there seems to be at least one implementation of that idea—bountysource.
September 14, at 1: Thanks for giving me stuff to research! September 15, at 3: September 15, at I had him send me his resume. Oddly, that never occurred to me, because he was.
Which explains why he chose it. September 14, at 3: September 16, at 2: October 5, at 3: But the religion is very much not a problem. September 14, at 4: September 14, at 9: September 16, at TheEternallyPerplexed Oh dear, but that is a template! Thank you for the feedback — really. September 17, at 1: However, the big problem is that the lines are much too long for easy readability.
Keep in mind that Rocket Internet believe the best startups to clone are those in eCommerce. One app that recently caught my eye is called GasBuddy. It allows users of the app to earn rewards by reporting the current price of petrol in their location. Well they clearly display on their homepage that they currently only service Seattle and the Bay Area before they focus on expansion.
I absolutely love this idea. If I owned a number of properties it sounds like a perfect solution. Maybe someone reading this is in another major city like Amsterdam, Cape Town, Miami, London, Madrid, Oslo or anywhere else in the world with high property rental rates. Let me go a step further and tell you the ten most popular Airbnb cities by number of listings. Not all of my ideas are going to just be based off spinning the location of an app or service.
You can also take an entire concept and simply apply it to a different industry as well. You make up one third of my audience, America, so I made sure not to forget you here. While it obviously requires work and smarts to put this together, Hopper is consistently in the top apps on the entire app store in the United States, even though it launched a few years ago.
What about a version that analyses hotel prices by monitoring the likes of Agoda to let you know when the best deals on rooms will be available. Or how about a version for car rentals that looks at the prices of the likes of Hertz to help you get the best deal. First for a reason, Crunchbase is my absolute favourite resource when it comes to finding great niche ideas to capitalise on. The reason Crunchbase is such a good tool is simple: It monitors startups that have received investments.
Just look at some of the investments from just this week that could give insights into future industries about to take off:. I think the real value is probably found in their custom reports which are going to set you back hundreds or thousands of dollars. A Reddit sub-Reddit, Internet is Beautiful showcases interesting websites and ideas that people have found online. This link will do just that for you. I think this is going to be one of the biggest breakthrough websites for just like Pinterest was when that first started out.
If nothing else, Product Hunt can be a great way to send thousands of visitors to your new creation if you truly get involved in the community.
Though I rarely fund projects on Kickstarter — I move around too often to have a dedicated delivery address — I do find a lot of inspiration in the hot products that make their way onto the site. This page allows you to see active listings meaning within 30 days of being published that are already funded. Meaning these are hot topics that the userbase of Kickstarter are excited about right now. Though I do warn that if you take it too far your mind is going to be constantly seeking them out; not just when you feel like it.
One site I follow is called Car Advice , which focuses on the Australian car market. As someone who was ahead of the trends when it came to launching a blog on car reviews and now knowing exactly how to deal with car manufacturers, I sense that Alborz is betting on this being a very profitable new venture.
Even more so if you live anywhere near a harbour or coastal area where you could actually take the latest boats out for a spin if given the opportunity. There are no doubt some people who are going to think this is not the most ethical of ways to make money online. On one hand, I can see how it would be disheartening for someone with an original website or app idea to see it taking off in another country or with a slightly different twist before they had time to get around to it.
Pinterest may have taken an approach to tagging interesting content in a new way, but Del. When the market leader in mens grooming, Gillette, felt competition from shaving clubs they just went and created their own. This little niche alone has quite a few funny pivots along the way.
I had fun highlighting them with a different coloured font. After all, the competition makes the average person win in the end. I have no doubt that this post — or the concept it represents — is going to result in a few project ideas hitting your mind in the next few days and weeks as the content here sinks in. And to further show you how few people actually take action, think about that Pomodoro With Me app I mocked up a few weeks ago. If you do the same, I would love to hear about your journey.
Yeah, when I read that article about the German brothers who made billions of dollars by cloning successful ecommerce businesses it definitely got my attention.
I remember meeting someone about a year ago from Sweden who was working in Asia for a group who also did something similar with cloning big ecommerce sites. I never registered that there was so much money to be made.
It definitely helps to be among the first. I had a decent level of success and a lot of great resources. Hi Glenn, I just finished your article and wanted to thank you. Hey Glen, I have been kicking myself over the past week for great ideas I had and never implemented.
I read down your post and told myself this one is for me. Thanks again for the great insights and the push. I literally was just saying to a friend of mine that I want to go to the grocery store to only buy food with a shelf life or that is fresh. But toiletries, shampoo, razors, paper towels, cleaning supplies, water, cereal, etc. Thanks for the article. Im actually doing it right now after browsing on Similarweb last month. Hell YES I enjoyed this post.
Will be trolling back through all the links next. My partner and I are creating a new website that aims to deliver online courses. Nope, delete that- we were creating a website about one course, only to have a chat five minutes ago realizing that this can become something substantially bigger.
Great, meaty post Glen! But with all that money they can afford to take chances and fail because the winners win big. Great article, thank you Glen. I Really like the way you research each and every topic of your ideas and giving away such precious information For FREE!!
I was literally thinking about something similar a week ago … Time to make it happen! Cloning is nothing new, after all Facebook built a better Myspace and the list goes on. Glen, You are the man. I sincerely appreciate the fact that you are willing to share your ideas with others. As for me I am in the process of getting my butt in gear and thinking about overseas. Having a little trouble with discovering how to do some of this but am motivated.
It takes time to unfold a great idea or ideas. I hope to continue seeing you as the bright light on my path to great ideas and success.
This shit is hilarious. These fools have me apprehensive to start my own original idea. But I guess they only copy the big dogs for now, save for Airbnb, etc.
I got a few ideas from it. I might try one in the real estate niche and see what else can be delivered to homes. This is an excellent article. I am working on this exact model of cloning as we speak for my under-served local population.
Once everything is put together, the target is going to be entrepreneurs and marketers in smaller towns where the Uber and grubHub giants will not come. What hit me the most was in the closing bit where you say how few people have taken action and brought to completion a finished product — at least a working prototype, from an idea you laid out pretty extensively in your last article.
I would be willing to bet a lot of people feel the same way i do…. For example the following are some excerpts from your article concerning money aquired to scale up or just get off the ground:. I know I probably should take rock climbing classes before i take on the Matterhorn…but I still have to know where to go for the classes…. Once again nice article…. People generally look for investors as they need to grow quickly. I had this idea before and I gave up thinking that I could not get it done.
Here is my question: I live in Barbados. Would you create a site that targets Barbados population , or would you create a site that targets the Caribbean population of 3. Really liked this post Glen. Not just some in-house content team for your own sites like some IMs but like a full-blown incubator with designers, engineers and marketers to take ideas from conception to reality. Honestly I think because so many of my ideas require people to be focused on generating traffic as well.
Glen i want to thank you for this awesome article. As soon as I received your email will running read. I found the idea interesting gasoline, if something happens I notice. Your e mails are read here in Brazil bro. I was reading about the other day of RocketInternet, they made huge progress in the middle-east market especially in the past few years.
Love it or Hate it, the guys are Rocket Internet seem to have the execution part of the business down and based on their market cap execution matters more than original ideas. The ethical side of the debate is a little tricky too because a lot of the unicorns seem to take things we already do and make them more efficient at scale.
Either way, competition is a good thing and the more companies continue to reduce friction on a global scale, the better our world should become. The company that makes the most money and pleases the most customers is the winner. Thank you for the great post.
Glen, that was a great article. I could see your research done on each information given which will surely give us a broader insight on Business Ideas to clone for countries. After reading this article, i went ahead and searched online for similar ideas and clones, I interestingly found a site called Proven Logic http: Just a tiny note: In the 70s, 80s and 90s, early enough was multiple years. At least be a little creative or different. I was once a partner in a small electronics startup. Two of my three partners had their own much larger related electronics company.
But, their strategy was to mimic successful products. Their secret being that they improved on the mimicked products however slightly plus supported and serviced their products well and usually better. This enabled them to grab significant market share from the established competitors. Great post Glen, thanks for sharing the knowledge and the ideas. I can see a couple of business that I think can work very well in my area.
This is such a detailed post and the last example of Gillette is actually a good one. I have seen many country specific websites in the recent years who are making and raising millions.
Definitely worth trying and absolutely not unethical in my opinion. Really interesting read Glen. Took longer than I thought when starting the article, but got more and more interesting!
Nice insight,am changing my business vision because of this article so that more value can be added. Great article, but takeaway is execution and not cloning. It is very easy to execute an idea but very very tough to execute at the speed which Rocket guys have done.
Just now getting up and reading again. As always great post Glen. I am doing this for the past years and have seen people do the same. Most of the business concepts are started in USA which can be easily replicated in other developing countries. People are still making a fortune by doing this. Most of the time the companies in USA take some time to expand globally which is the main gap where people take time to replicate the business concept with slight changes to suit their countries.
Mostly i have seen this trend happening in all industries. These things started happening after the globalization of the internet. Nothing new, and these guys have made a good business out of it — http: After I reading this article, I went ahead, registered a domain.