andywojo

Activity Graph

Page 1 of 3 | Next »

2018-09-03

[19:10:26] andywojo: *.net *.split

2018-07-20

[00:07:25] andywojo: *.net *.split
[00:15:47] andywojo: has joined #ruby

2018-06-20

[03:52:26] andywojo: Ping timeout: 276 seconds
[05:23:05] andywojo: has joined #ruby
[05:57:15] andywojo: Ping timeout: 276 seconds
[06:20:10] andywojo: has joined #ruby

2018-06-01

[03:44:46] andywojo: *.net *.split
[07:47:35] andywojo: has joined #ruby

2018-05-29

[02:47:14] andywojo: *.net *.split
[02:47:56] andywojo: has joined #ruby

2018-05-28

[10:01:16] andywojo: *.net *.split

2018-05-19

[15:33:50] andywojo: Remote host closed the connection
[15:38:28] andywojo: has joined #ruby

2018-05-06

[11:50:20] andywojo: has joined #ruby

2018-04-26

[02:12:50] andywojo: Ping timeout: 256 seconds

2018-04-25

[12:25:48] andywojo: *.net *.split
[12:27:17] andywojo: has joined #ruby
[15:01:19] andywojo: *.net *.split
[15:03:20] andywojo: has joined #ruby
[16:10:23] andywojo: *.net *.split

2018-04-17

[14:11:39] andywojo: Ping timeout: 276 seconds
[14:19:57] andywojo: has joined #ruby

2018-04-10

[14:17:44] andywojo: has joined #ruby

2018-03-09

[22:28:25] andywojo: Ping timeout: 256 seconds
[22:28:57] andywojo: has joined #ruby

2018-03-02

[04:10:49] andywojo: Ping timeout: 256 seconds
[04:19:01] andywojo: has joined #ruby

2018-02-25

[09:34:49] andywojo: *.net *.split
[09:36:30] andywojo: has joined #ruby

2018-02-09

[23:05:00] andywojo: has joined #ruby

2018-01-18

[03:30:05] andywojo: *.net *.split
[03:31:56] andywojo: has joined #ruby

2017-12-27

[19:13:30] andywojo: Write error: Connection reset by peer
[19:43:22] andywojo: has joined #ruby

2017-12-01

[02:28:44] andywojo: has joined #ruby

2017-11-27

[11:54:45] andywojo: Ping timeout: 255 seconds
[11:55:25] andywojo: has joined #ruby

2017-11-16

[07:23:01] andywojo: Ping timeout: 255 seconds
[07:25:25] andywojo: has joined #ruby

2017-11-06

[13:23:42] andywojo: Read error: Connection reset by peer
[13:24:15] andywojo: has joined #ruby

2017-10-16

[06:24:17] andywojo: Ping timeout: 246 seconds
[06:26:36] andywojo: has joined #ruby

2017-09-04

[00:12:19] andywojo: has joined #ruby

2017-05-01

[00:53:11] andywojo: Quit: Connection closed for inactivity

2017-04-30

[11:03:11] andywojo: Quit: Connection closed for inactivity
[12:49:36] andywojo: has joined #ruby
[16:03:11] andywojo: Quit: Connection closed for inactivity
[22:47:05] andywojo: has joined #ruby

2017-03-28

[01:25:29] andywojo: Ping timeout: 240 seconds
[01:27:44] andywojo: has joined #ruby

2016-07-21

[12:08:15] andywojo: If I use the peach gem (parallel each) can I safely have each 'thread' write to a file at the same time?
[12:08:18] andywojo: Or do I need to do something specia
[12:12:06] andywojo: So I can't just have them all write to a file? I have a 1000 files I want to loop through and append them all to one master file
[12:12:47] andywojo: Yeah, not gonna do that
[12:13:06] andywojo: Yeah I'll just do it serially
[12:15:06] andywojo: Thanks for the advice
[13:32:22] andywojo: already exists?
[13:32:22] andywojo: So I have a 23GB log file with 2 colums I care about, I'm looping through the file and creating a simple k => v hash (where v is an array of things). But the columns contain many of the same things, and I'm doing a .uniq after it's loaded all of the data into the array... would it be faster to not insert it into the array and check to see if the duplicate
[13:33:02] andywojo: Also, I'm loading the file into an array to loop over by doing %x[cat file].split("\n"), I'm thinking that's also bad.
[13:35:17] andywojo: is it quicker to check to see if an array already has an element before inserting or just inserting and doing a uniq at the end?
[13:37:00] andywojo: file is 23gb
[13:37:16] andywojo: what should I use/
[13:45:46] andywojo: wow sets are so much faster
[13:45:48] andywojo: why is that?
[13:47:06] andywojo: I do not, I am a newbie.
[13:47:26] andywojo: I understand the concept
[13:48:33] andywojo: gotcha, that makes sense
[13:48:50] andywojo: so.. it's a structured 'indexed' array?
[13:52:27] andywojo: Sure, in my head it makes sense. but the terms are probably definitely wrong
[13:52:49] andywojo: I use ruby purely from a sysadmin perspective, so I probably learned a lot of things wrong
[13:56:38] andywojo: Well at this point I'm extremely comfortable with ruby, even more so then bash (except for fringe cases with large data sets)
[13:56:49] andywojo: I do want to learn python
[13:56:55] andywojo: but I find it obtuse compared to Ruby
[13:58:01] andywojo: Bash, some perl,
[13:58:47] andywojo: I converted over to each_line and using sets, and the script is no longer locking my workstation up, so that's good
[13:59:50] andywojo: Yeah it's 23 GB of http logs. I'm looping through them and finding all of the users and URLs each user goes to (no dupes) and creating a CSV with user,url
[14:00:38] andywojo: I'm running it with time, we'll see how long it takes
[14:00:58] andywojo: what do you mean format?
[14:01:02] andywojo: It's an ASCII file
[14:01:41] andywojo: It's <ip> <something> <user> <something> <something> <something> <something> <url>
[14:01:52] andywojo: So I'm doing a split on each line for the user[2] and the url[6]
[14:02:56] andywojo: I'll write it in bash, and compare the times
[14:05:09] andywojo: you're missing the part where I am a ruby newbie, and I now learned some valuable lessons about sets and f.each_lines
[14:06:04] andywojo: I bet, I could probably find the open file and see where the read position is in the 23GB file to see how far ruby has gotten

2016-07-10

[05:00:02] andywojo: *.net *.split
[08:54:05] andywojo: has joined #ruby

2016-06-09

[05:25:07] andywojo: Ping timeout: 250 seconds
[05:37:15] andywojo: has joined #ruby
[06:08:15] andywojo: Ping timeout: 260 seconds
[06:12:13] andywojo: has joined #ruby

2016-06-03

[21:15:58] andywojo: has joined #ruby
[21:16:21] andywojo: if I have a string = "1 2 3 4 5 6 7", how do I split it to grab the fields 3-7
[21:16:57] andywojo: string.split(" ")[2-8]
[21:17:03] andywojo: something like that but just till the end
[21:18:47] andywojo: perfect, thanks!

2016-04-09

[18:53:46] andywojo: Quit: leaving

2016-04-08

[12:51:24] andywojo: Quit: leaving
[13:32:23] andywojo: has joined #ruby
[21:57:28] andywojo: Quit: leaving
[22:48:01] andywojo: has joined #ruby

2016-04-07

[12:55:47] andywojo: Ping timeout: 244 seconds
[13:29:40] andywojo: has joined #ruby
[22:16:29] andywojo: Ping timeout: 260 seconds
[22:19:27] andywojo: has joined #ruby
[22:23:57] andywojo: Ping timeout: 246 seconds
[23:17:27] andywojo: has joined #ruby

2016-04-06

[12:46:19] andywojo: Ping timeout: 252 seconds
[13:17:20] andywojo: has joined #ruby
[21:56:52] andywojo: Ping timeout: 252 seconds
[22:02:53] andywojo: has joined #ruby
[22:08:41] andywojo: Ping timeout: 244 seconds
[22:23:17] andywojo: has joined #ruby
[22:27:47] andywojo: Ping timeout: 248 seconds
[23:01:10] andywojo: has joined #ruby

2016-04-05

[02:20:56] andywojo: Ping timeout: 244 seconds
[02:23:53] andywojo: has joined #ruby
[10:34:34] andywojo: Ping timeout: 240 seconds
[10:59:55] andywojo: has joined #ruby
[20:12:28] andywojo: Ping timeout: 252 seconds
[21:16:25] andywojo: has joined #ruby
[21:21:09] andywojo: Ping timeout: 260 seconds
[21:37:29] andywojo: has joined #ruby

2016-04-04

[00:02:18] andywojo: has joined #ruby
[00:10:04] andywojo: Ping timeout: 264 seconds
[00:32:49] andywojo: has joined #ruby
[01:18:09] andywojo: Ping timeout: 250 seconds
[01:37:01] andywojo: has joined #ruby
[01:45:43] andywojo: Ping timeout: 268 seconds
[01:47:48] andywojo: has joined #ruby
[01:56:16] andywojo: Ping timeout: 264 seconds
[01:58:36] andywojo: has joined #ruby
[02:12:11] andywojo: Ping timeout: 244 seconds
[02:15:45] andywojo: has joined #ruby
[02:26:19] andywojo: Ping timeout: 260 seconds
[02:29:58] andywojo: has joined #ruby
[02:37:30] andywojo: Ping timeout: 244 seconds
[02:40:02] andywojo: has joined #ruby
[02:44:49] andywojo: Ping timeout: 250 seconds
[02:45:26] andywojo: has joined #ruby
[02:50:56] andywojo: Ping timeout: 244 seconds
[11:03:15] andywojo: has joined #ruby
[11:08:07] andywojo: Ping timeout: 268 seconds
[11:41:42] andywojo: has joined #ruby
[11:47:27] andywojo: Ping timeout: 276 seconds
[11:53:45] andywojo: has joined #ruby
[11:58:36] andywojo: Ping timeout: 244 seconds
[12:36:28] andywojo: has joined #ruby
[22:16:40] andywojo: Ping timeout: 264 seconds
[23:18:25] andywojo: has joined #ruby

2016-04-03

[02:29:27] andywojo: Ping timeout: 246 seconds
[04:13:25] andywojo: has joined #ruby
[04:21:23] andywojo: Ping timeout: 248 seconds
[06:03:11] andywojo: has joined #ruby
[06:36:15] andywojo: Ping timeout: 250 seconds
[07:54:56] andywojo: has joined #ruby
[08:27:18] andywojo: Ping timeout: 244 seconds
[09:23:36] andywojo: has joined #ruby
[09:32:30] andywojo: Ping timeout: 276 seconds
[11:12:05] andywojo: has joined #ruby
[11:46:24] andywojo: Ping timeout: 276 seconds
[13:03:55] andywojo: has joined #ruby
[13:12:03] andywojo: Ping timeout: 248 seconds
[14:51:51] andywojo: has joined #ruby
[15:26:45] andywojo: Ping timeout: 276 seconds
[16:42:58] andywojo: has joined #ruby
[16:52:18] andywojo: Ping timeout: 268 seconds
[18:31:30] andywojo: has joined #ruby
[19:05:54] andywojo: Ping timeout: 260 seconds
[20:22:41] andywojo: has joined #ruby
[20:30:27] andywojo: Ping timeout: 248 seconds
[22:13:39] andywojo: has joined #ruby
[22:44:51] andywojo: Ping timeout: 248 seconds

2016-04-02

[00:21:27] andywojo: Read error: Connection reset by peer
[00:25:22] andywojo: has joined #ruby
[01:37:36] andywojo: Ping timeout: 276 seconds
[02:33:32] andywojo: has joined #ruby
[02:42:17] andywojo: Ping timeout: 250 seconds
[04:22:11] andywojo: has joined #ruby
[04:55:33] andywojo: Ping timeout: 244 seconds
[06:13:57] andywojo: has joined #ruby
[06:21:55] andywojo: Ping timeout: 248 seconds
[07:19:03] andywojo: has joined #ruby
[07:23:49] andywojo: Ping timeout: 268 seconds
[09:06:29] andywojo: has joined #ruby
[09:41:20] andywojo: Ping timeout: 268 seconds
[10:57:31] andywojo: has joined #ruby
[11:06:57] andywojo: Ping timeout: 260 seconds
[12:46:06] andywojo: has joined #ruby

2016-04-01

[00:34:19] andywojo: has joined #ruby
[11:08:19] andywojo: Read error: Connection reset by peer
[12:17:21] andywojo: has joined #ruby
[18:48:36] andywojo: Ping timeout: 246 seconds
[19:52:45] andywojo: has joined #ruby

2016-03-31

[01:14:04] andywojo: Ping timeout: 240 seconds
[01:36:40] andywojo: has joined #ruby
[11:05:41] andywojo: Quit: Lost terminal
[11:50:38] andywojo: has joined #ruby
[20:23:54] andywojo: Ping timeout: 260 seconds

2016-03-30

[10:33:22] andywojo: Ping timeout: 252 seconds
[11:05:43] andywojo: has joined #ruby
[13:21:02] andywojo: Ping timeout: 248 seconds
[21:42:55] andywojo: has joined #ruby

2016-03-29

[10:45:01] andywojo: Quit: Lost terminal
[11:55:24] andywojo: has joined #ruby
[12:37:04] andywojo: Ping timeout: 264 seconds
[13:00:17] andywojo: has joined #ruby
[13:05:07] andywojo: Ping timeout: 248 seconds
[13:54:23] andywojo: has joined #ruby
[13:59:34] andywojo: Ping timeout: 260 seconds
[14:48:32] andywojo: has joined #ruby
[14:54:43] andywojo: Ping timeout: 252 seconds
[15:43:04] andywojo: has joined #ruby
[15:47:46] andywojo: Ping timeout: 244 seconds
[16:15:33] andywojo: has joined #ruby
[17:07:32] andywojo: Ping timeout: 268 seconds
[20:49:47] andywojo: has joined #ruby

2016-03-28

[00:10:49] andywojo: has joined #ruby
[01:35:21] andywojo: Ping timeout: 244 seconds
[02:28:40] andywojo: has joined #ruby
[02:33:32] andywojo: Ping timeout: 260 seconds
[03:29:26] andywojo: has joined #ruby
[03:35:51] andywojo: Ping timeout: 276 seconds
[05:17:44] andywojo: has joined #ruby
[05:23:04] andywojo: Ping timeout: 260 seconds
[07:05:56] andywojo: has joined #ruby
[07:11:39] andywojo: Ping timeout: 276 seconds
[08:54:09] andywojo: has joined #ruby
[08:59:07] andywojo: Ping timeout: 244 seconds
[10:42:20] andywojo: has joined #ruby
[10:47:26] andywojo: Ping timeout: 248 seconds
[15:03:01] andywojo: has joined #ruby
[19:04:31] andywojo: Ping timeout: 252 seconds
[19:46:45] andywojo: has joined #ruby
[19:52:15] andywojo: Ping timeout: 268 seconds
[20:15:13] andywojo: has joined #ruby