Page 1 of 2 | Next »
[17:28:13] samosaphile: havenwood: i liked that spidr crawler gem you linked to yesterday .. the only problem i'm having with it is, it seems to do a breadth first search (meaning scan all folders in higher level directories) before moving to lower levels. Need to somehow make it depth first (i.e. crawl deep first then move on) but not too sure how
[18:04:23] samosaphile: havenwood: not sure what the difference is or if i understand you question correctly .. basically that site, the directory goes like: Day folders -> Name folders -> Contents (.rep file, .txt file, .jpg files) .. but I only need to read .txt files (ignore everything else)
[18:05:35] samosaphile: havenwood: right now, it tries to download (or print I mean) all like Day folders first, then all name folders first ... before getting to actual contents (.txt files)
[19:22:51] samosaphile: any idea how to build a web crawler/scraper in ruby? something that can for example, go through each directory and subdirectory, here: http://gentool.net/data/zh/ looking for .txt files such as http://gentool.net/data/zh/2018_07_July/09_Monday/-beginner-_EKDSILEHOIEI/17-53-11_2v2v2_wuestenf_MaSTeRAc_beginner_akagoisU_Goopher4_SolidSna.txt then like read or scrape certain info from these .txt files but not all?
[19:31:25] samosaphile: is it really hard building your own? like what topics do you need to know or understand? i was thinking of using like library/framework but they all seem so bloated and like have hundreds of features but what im trying to crawl/scrape seems simple but idk
[19:39:28] samosaphile: well....i guess you've to download everything anyway to read/see... what is within it first and then filter / discard info you don't want...
[19:41:06] samosaphile: it's just so confusing when there's like a million frameworks to do same thing, which one to pick
[19:55:15] samosaphile: lupine: yeah, you're right..they just downloading + html parsing... i don't need everything tho..just realized most of those folders are empty... so just need to write something like looks for folder of current month (july) and maybe previous month (june) .. then somehow like maybe do .scan/*.txt/ or some kind of regex scan for only .txt files in folder so it only download those instead of like everything else
[20:01:30] samosaphile: i just don't understand how .. like website has (A) directory with folders -> (B) sub directory with folders -> (C )the files (.rep, .jpeg, .txt) .. so like going from A -> B -> C ... do you need to download everything in B to get to C?
[15:29:04] samosaphile: https://pine.fm/LearnToProgram/chap_06.html - "...Change your previous program so that you have to shout BYE three times in a row. Make sure to test your program: if you shout BYE three times, but not in a row, you should still be talking..." <- how does one do this?
[17:07:32] samosaphile: optikalmouse: any idea how to write (".".join(str(int(x, 16)) for x in (["".join(x) for x in zip(*[iter(UID)]*2)]))) or ('.'.join(str(int(i, 16)) for i in ([UID[i:i+2] for i in range(0, len(UID), 2)]))) (does same thing) in ruby? it's supposed to convert little endian hex string to IP
[17:29:03] samosaphile: hey, any idea how to write something in ruby which takes hex and converts to IP? like ... example input: 55905E48 desired output: 188.8.131.52
[17:53:58] samosaphile: havenwood: im interested .. just don't know where to begin.. like i really don't understand any of it :/
[18:01:38] samosaphile: when you did >> '55'.hex <-- what does the dot behind hex do? dot = method? is there a way to find like a list of like dot commands in ruby intrepreter?
[18:03:22] samosaphile: sorry, am abit slow... this probably going to take me like 2 weeks to actually get it lol
[18:09:16] samosaphile: i'm actually still confused over <Zarthus> that's just the return value of IPAddr#inspect like where do you add #inspect in irb(main):008:0> IPAddr.new "55905E48".hex, Socket::AF_INET => #<IPAddr: IPv4:184.108.40.206/255.255.255.255>
[18:10:45] samosaphile: IPAddr.new("55905E48".hex, Socket::AF_INET).to_s <- this does work tho... not sure why doing .to_s makes it ignore 255 part
[13:17:23] samosaphile: how do you make it so that, 'require 'bootsnap/setup'' is permanently commented out or removed from config/boot.rb, so that whenever i do rails new app, i don't have to manually do it everytime (because it creates that line automatically be default)
[13:27:38] samosaphile: tbuehlmann: https://github.com/Shopify/bootsnap/issues/67 https://gitlab.com/gitlab-org/gitlab-ce/issues/45230 bootsnap is broken on armv7 (running rails on ubuntu chroot on a arm chromebook)
[12:55:03] samosaphile: thx:) , altho getting new errors now, atleast it fixed my rake errors...was getting a heartattack lol... completed like 110/282 of koans stuff and then suddenly rake broke.. never before happened. so was surprise...
[20:13:18] samosaphile: anyone have the solutions to these: https://pine.fm/LearnToProgram/chap_06.html not sure if am doing it right. so far done: https://repl.it/repls/GiantLimpingRoute https://repl.it/repls/AngryGoldenrodWaterfall kinda stuck on how to do third one
[20:17:34] samosaphile: well, i just dunno how to make something which asks for same input 3 times...and when condition met exists..
[20:20:22] samosaphile: also, does the term 'command' have special meaning in ruby? cuz i've found if i replace word with another word, it doesn't work .. or starts to show errors / warnings(?)
[20:26:15] samosaphile: had to change all my variable names from 'Talk' to 'command' to make warnings go away on repl.it... :S wtf
[20:42:03] samosaphile: not too sure what this rubykoans stuff is about but do you really need to ruby installed locally for this, or would repl.it be fine?
[13:05:46] samosaphile: is there a reason why haskell has no or few libraries/frameworks but OOP stuff (java, python, c# / .NET, etc) have tons? despite haskell being older language? well, i guess you could say java was backed by sun/oracle and c# by MS, which helped but ruby/python weren't ...
[13:09:28] samosaphile: what happens if you need a library in python/ruby but write something in haskell? is it possible to use libraries from different languages?
[13:25:32] samosaphile: i don't understand dminuoso if you really hate web so much, why not just use rust instead?
[15:11:34] samosaphile: hmm, doesn't seem haskell is great for gui stuff, http://www.scs.stanford.edu/14sp-cs240h/projects/martinez.pdf https://www.reddit.com/r/haskell/comments/3z6961/designing_a_gui_library_purely_in_haskell/cyjskts/
[22:57:41] samosaphile: why are there no rails tutorials which don't deal with registration / login ? not everyone is trying build something to force users to register
[23:09:02] samosaphile: yea, i was shocked at the change now too. i tried it a few months ago and just tried it today and completely different site
[23:17:10] samosaphile: it's also beginning to annoy me that the few resources left for rails ... like half of them are paid? not funny ... and why on earth would you? like now of all the times? who exactly is trying to learn rails now? (besides like me) no one in 2018 lol
[10:32:32] samosaphile: IMO, one of reason(s) why there is so much money in web dev stuff now is because of the emergence of technologies like nodejs which enable more powerful like web apps.
[10:32:44] samosaphile: If you know how to deploy web app's like on cloud (e.g. AWS, GCP, etc) you're basically doing devops stuff almost. Atm right now, there is allot of money for knowing how to setup, config web apps in containers. Yes, if you just know 1997 HTML no one is going to care, just in the same way knowing 1997 python will get you nowhere.
[10:32:55] samosaphile: If you stay stagnant in any field you'll get nowhere (especially in tech field) but it is a stepping stone. Just like you can't break into ML / DL field without knowing the foundations of python. Knowing the foundations of web dev / JS help enable you to understand devops / cloud. (because 90% of the stuff being deployed on AWS is stuff like JS web apps and mobile apps)
[10:36:07] samosaphile: you can hate web dev stuff all you want but the future is all about collaboration and openness
[10:37:14] samosaphile: dev stuff didn't really get big or mainstream until stuff like github came around imo
[11:04:41] samosaphile: all those features that erlang has may sound nice and all, but where is the industry mass adoption
[11:09:28] samosaphile: the features i want the problems am trying to solve don't see how stuff like erlang or haskell would help at all
[11:20:36] samosaphile: but lol dminuoso i don't know how you ended up here in rails in the first place with your hate of web xD .. surprised you're in ruby ... instead of like rust or somewhere
[11:21:53] samosaphile: anyways, my point was just to show that there is money in web dev stuff. think i proved this point. so mission accomplished.
[11:25:42] samosaphile: but i suppose there is money in anything if you're good at it... just that you said avg. salary in us was 60k / yr. yes, it is, but it can easily be doubled switching to learning devops stuff. i guess you could say the same about erlang or haskell, but i just don't know or am aware even of erlang/haskell being popular in cloud to deploy stuff on aws and stuff
[11:27:34] samosaphile: altho im not even sure why i keep mentioning devops as it seems dead boring and something only companies care about