gheegh

Activity Graph

Page 1 of 5 | Next »

2019-09-05

[16:33:48] gheegh: Ping timeout: 245 seconds

2019-09-04

[17:06:05] gheegh: has joined #ruby
[17:06:05] gheegh: has joined #RubyOnRails
[17:07:47] gheegh: so, i have a question guys.. i'm super confused.. I have a system that uses sidekiq. When I launch it.. i get 100% failure rate with a NoMethodError. The error comes from an old version of a gem. When i Rails console and run the same job with the same arguments, it doesn't have a problem (it uses the right version of the gem). Why would sidekiq not be using the same gems as rails?
[17:08:01] gheegh: so, i have a question guys.. i'm super confused.. I have a system that uses sidekiq. When I launch it.. i get 100% failure rate with a NoMethodError. The error comes from an old version of a gem. When i Rails console and run the same job with the same arguments, it doesn't have a problem (it uses the right version of the gem). Why would sidekiq not be using the same gems as rails?
[17:08:40] gheegh: i have literally gone into my machine and deleted all the previous versions of gems in various folders
[17:10:17] gheegh: what's also weird, is that these report to Airbrake.. and AirBrake says the file location is /bundler/gems/. But, there's no /bundler folder on this machine.
[17:12:57] gheegh: sorry.. #ruby is my go to normally.. after i posted, i realized it was probably a rails question
[17:13:29] gheegh: phaul i am using bundle exec
[17:13:34] gheegh: both for rails and for sidekiq
[17:15:04] gheegh: it's a really strange thing.. i'm thoroughly confused.. i've spent several hours trying to figure out why my fixes weren't working, and realized it's still using an old version
[17:31:35] gheegh: dang Tmux. I had closed some sessions wiht workers in them.. and it didn't kill the process.. that was why.

2019-08-30

[12:10:15] gheegh: Quit: Textual IRC Client: www.textualapp.com

2019-08-29

[11:03:20] gheegh: has joined #RubyOnRails
[11:03:20] gheegh: has joined #ruby
[11:05:22] gheegh: file itself already processed, but I guess that's deprecated now? Any thoughts on how to eliminate the IO and preprocessing?
[11:05:22] gheegh: hey all. Question. I have a gem i wrote that i'm tyring to improve the speed of. Basically, every time it runs, it loads its config file from disk (0.04s) and deserializes data (0.04) taking almost a 10th of a second. Not that big of a problem, except that this is called HUNDREDS of times per each process. This ends up adding almost 10 seconds to a job process. I was looking at adding the data to the bottom of the config.rb
[12:07:48] gheegh: right now, i'm just throwing them into hashes that are in the source code itself.. which is a bit clumsy.. but it might work.. if that owrks, then i'll generate a rake/bin type task that takes the config data and genreates a class that has this data in it.. so we can update the config in a nice yaml format and then produce the cached/computed file..
[12:08:16] gheegh: so that the data is loaed, pre-computed, on source code load
[12:08:36] gheegh: because the other slow part is that we compute indexes on the data..
[12:08:51] gheegh: yeah.. that's the plan. Thanks for the feedback!
[12:09:01] gheegh: good to konw i'm not doing it totally wrong
[12:13:11] gheegh: yeah, its nto the ruby part.. but it's a Gem
[12:13:24] gheegh: i have that in my Gem the GemName. config
[12:13:37] gheegh: but i'm trying to cache what that does when it loads the file
[12:15:41] gheegh: so, the problem is that the gem is called every time we need to parse a URL
[12:15:51] gheegh: and so this conf file gets initialized over and over again
[12:16:09] gheegh: no, i can generate a config file from teh raw one that's not readable..
[12:19:39] gheegh: Yea, let me get this part sorted then I will..
[12:20:15] gheegh: its got a module_function method that is the main "callable" called .parse and this pulls data from the config when it needs it
[12:20:43] gheegh: and in the config they're all modules with memoized instance variablels
[12:20:55] gheegh: but every time the Gem.parse is called, it reloads the config
[12:21:16] gheegh: or at least prints the puts i added in the memoized work part

2019-08-09

[11:27:48] gheegh: Quit: Textual IRC Client: www.textualapp.com

2019-08-06

[20:48:04] gheegh: reclaim that ram? Does that even make sense?
[20:48:04] gheegh: Hey all.. question. I have a problem where my sidekiq processes just seem to grow and grow and grow.. I've spent a week or so profiling, and i think the problem boils down to that we do retrievals, and when we get several big ones at once, the ruby process consumes more memory. .and never releases it. So, i'm wondering, has anyone ever FORKED in the middle of a sidekiq process (to wrap the retriever part), so i can then

2019-08-05

[14:14:52] gheegh: has joined #ruby
[14:14:52] gheegh: has joined #RubyOnRails
[14:19:56] gheegh: threads and everything is dead. Thoughts?
[14:19:56] gheegh: Hey all.. I'm wondering if anyone knows of any guide on best practices for jobs that "retrieve data"? I have a system that's doing hundreds of thousands of jobs.. occasionally.. my Sidekiq job gets locked up.. and then re-queues itself, then it just seems to cascade.. what i need is a clean Timeout that will, after a fixed period of time, re-queue to a problem queue. Over the course of a day, it will lock up all my worker
[14:33:42] gheegh: yeah, but Sidekiq writes all over their code base not to use Timeout because it's not thread safe.
[14:34:09] gheegh: to timeout the underlying process, retrieve, etc. which i've done.. but there are still some case where it locks the thread..

2019-06-18

[15:44:31] gheegh: Quit: Textual IRC Client: www.textualapp.com

2019-06-16

[17:21:42] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[20:49:14] gheegh: has joined #ruby
[20:49:19] gheegh: has joined #RubyOnRails

2019-06-15

[20:13:42] gheegh: has joined #RubyOnRails
[20:13:47] gheegh: has joined #ruby

2019-03-27

[19:10:03] gheegh: Ping timeout: 246 seconds

2019-03-25

[16:47:33] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[16:52:38] gheegh: has joined #RubyOnRails
[16:52:43] gheegh: has joined #ruby
[17:21:50] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[18:04:38] gheegh: has joined #ruby
[18:04:41] gheegh: has joined #RubyOnRails

2019-03-23

[13:31:35] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[13:43:12] gheegh: has joined #ruby
[13:43:34] gheegh: has joined #RubyOnRails
[13:43:57] gheegh: Client Quit
[14:45:56] gheegh: has joined #RubyOnRails
[14:46:16] gheegh: has joined #ruby
[14:53:17] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[15:30:01] gheegh: has joined #ruby
[15:30:06] gheegh: has joined #RubyOnRails
[16:26:14] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[21:38:38] gheegh: has joined #ruby
[21:38:42] gheegh: has joined #RubyOnRails

2019-03-21

[00:16:17] gheegh: has joined #ruby
[00:16:17] gheegh: has joined #RubyOnRails
[00:18:00] gheegh: hey all, anyone have a suggestion as to how to "memoize" a dynamic singleton class variable?
[00:19:55] gheegh: I've got a folder that has a bunch of files in it that i'm converting into class methods on a class. I just realized that one of hte problems is that its reloading them from disk every time it's called, versus just 1 time. I need to "memoize" them.. but i'm not sure exactly how to do that. Here's a gist.. imagine the files as something that i'm turning into Arrays..
[00:19:57] gheegh: https://gist.github.com/wflanagan/e34d74a0586c0bd71a46106abd6341c8
[00:45:51] gheegh: so, this works.. its just that it seems to reload the method everytime it's called
[00:46:24] gheegh: that doesn't work in the def from what I can tell
[00:47:13] gheegh: the problem is the name is dynamic
[00:47:42] gheegh: so setting @#{dyanmic_method_name} ||= do_the_work doesn't seem to work

2019-02-25

[00:00:21] gheegh: Remote host closed the connection

2019-02-22

[12:26:49] gheegh: has joined #RubyOnRails
[12:26:49] gheegh: has joined #ruby

2019-02-20

[18:48:24] gheegh: has joined #RubyOnRails
[18:48:29] gheegh: has joined #ruby
[18:57:00] gheegh: Anyone work with active_admin? I've got a problem with a custom form. It's not rendering well, and fields are not showing. Rails 5.2 latest everything. https://gist.github.com/wflanagan/5f73eab4dfdd93aadf74d98fa4c62ba5
[18:57:16] gheegh: I've love some advice.. been working on a single form 3 hours.. Ugh. :-)
[19:02:06] gheegh: maybe I'll ask here, as it's maybe busier.. i have an ActiveAdmin issue. My custom form is totally not working.
[19:02:31] gheegh: It's not rendering well, and fields are not showing. Rails 5.2 latest everything. https://gist.github.com/wflanagan/5f73eab4dfdd93aadf74d98fa4c62ba5 gist shows a link to a pic, and the rendered HTML (and source of form)
[20:11:59] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[20:20:34] gheegh: has joined #ruby
[20:20:34] gheegh: has joined #RubyOnRails
[20:24:16] gheegh: Client Quit

2018-12-12

[00:24:37] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[10:36:20] gheegh: has joined #ruby
[10:36:20] gheegh: has joined #RubyOnRails
[12:40:18] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[12:55:20] gheegh: has joined #ruby
[12:55:24] gheegh: has joined #RubyOnRails
[15:33:33] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[18:08:46] gheegh: has joined #RubyOnRails
[18:08:47] gheegh: has joined #ruby
[18:31:50] gheegh: Quit: Textual IRC Client: www.textualapp.com

2018-12-11

[19:22:01] gheegh: has joined #ruby
[19:22:07] gheegh: has joined #RubyOnRails
[23:22:11] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[23:30:42] gheegh: has joined #ruby
[23:30:42] gheegh: has joined #RubyOnRails

2018-12-05

[14:40:31] gheegh: Quit: Textual IRC Client: www.textualapp.com

2018-12-04

[13:52:19] gheegh: has joined #RubyOnRails
[13:52:24] gheegh: has joined #ruby

2018-10-29

[13:00:35] gheegh: has joined #RubyOnRails
[13:00:35] gheegh: has joined #ruby
[13:06:16] gheegh: hey all.. i need some thoughts. I'm trying to dynamically define a class as a child of OpenStruct, if it's not defined. If defined, I want to just use it. Basically, i'm trying to wrap OpenSturct for responses to an API call. I'm getting a nameerror when trying to use my defined class. thoughts on how to do this?
[13:06:18] gheegh: https://gist.github.com/wflanagan/515b04b3448d9494df5fc386ce3b75c3
[13:07:46] gheegh: sorry, to follow the guide, here's the code snippet defined at dpaste.de https://dpaste.de/OEJz#L
[17:45:55] gheegh: Quit: Textual IRC Client: www.textualapp.com

2018-10-09

[20:57:55] gheegh: has joined #RubyOnRails
[20:58:00] gheegh: has joined #ruby
[21:03:29] gheegh: Hey all, i'm having a problem with VCR in some of my tests.. i am doing the query in the "let", but it seems to retrieve each time no matter what.. any thoughts on how to fix this in RSpec?
[21:03:31] gheegh: https://gist.github.com/wflanagan/59f0434d11079ace97ed4679d503d31d
[21:03:35] gheegh: that's an example
[21:17:23] gheegh: hey all.. anyone using VCR? I'm having some problem figuring out what to do to get my "let" in RSPEC not re-retrieve the page..
[21:18:41] gheegh: https://gist.github.com/wflanagan/59f0434d11079ace97ed4679d503d31d this is an example.. not sure what i'm doing wrong.. the URL is identical.
[21:47:44] gheegh: yeah, but i would have thought vcr would have matched it.. and returned the value
[21:47:59] gheegh: since the URL is the same
[23:44:13] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…

2018-08-14

[13:07:54] gheegh: Quit: Textual IRC Client: www.textualapp.com

2018-08-13

[02:09:17] gheegh: has joined #ruby
[02:09:23] gheegh: has joined #RubyOnRails
[02:42:24] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[11:06:31] gheegh: has joined #RubyOnRails
[11:06:32] gheegh: has joined #ruby
[13:43:49] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[13:44:44] gheegh: has joined #ruby
[13:44:44] gheegh: has joined #RubyOnRails
[15:39:34] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[15:44:46] gheegh: has joined #ruby
[15:45:12] gheegh: has joined #RubyOnRails
[16:52:19] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[17:03:23] gheegh: has joined #RubyOnRails
[17:03:55] gheegh: has joined #ruby
[17:22:58] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[17:56:03] gheegh: has joined #RubyOnRails
[17:56:32] gheegh: has joined #ruby
[18:38:22] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[21:11:02] gheegh: has joined #RubyOnRails
[21:11:02] gheegh: has joined #ruby

2018-08-12

[10:09:05] gheegh: has joined #RubyOnRails
[10:09:06] gheegh: has joined #ruby
[12:11:31] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[12:16:28] gheegh: has joined #ruby
[12:16:28] gheegh: has joined #RubyOnRails
[12:31:47] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…

2018-08-11

[10:34:06] gheegh: has joined #ruby
[10:34:06] gheegh: has joined #RubyOnRails
[11:13:10] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[11:14:34] gheegh: has joined #ruby
[11:14:37] gheegh: has joined #RubyOnRails
[11:14:56] gheegh: Client Quit
[11:24:16] gheegh: has joined #ruby
[11:24:16] gheegh: has joined #RubyOnRails
[11:35:23] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[11:51:37] gheegh: has joined #RubyOnRails
[11:51:42] gheegh: has joined #ruby
[11:52:47] gheegh: Client Quit
[14:30:24] gheegh: has joined #ruby
[14:30:30] gheegh: has joined #RubyOnRails
[14:33:30] gheegh: Client Quit
[14:35:22] gheegh: has joined #ruby
[14:35:37] gheegh: has joined #RubyOnRails
[14:38:01] gheegh: Client Quit
[18:54:22] gheegh: has joined #RubyOnRails
[18:54:40] gheegh: has joined #ruby
[19:03:13] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[23:19:11] gheegh: has joined #RubyOnRails
[23:19:21] gheegh: has joined #ruby
[23:39:08] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…

2018-08-10

[13:43:09] gheegh: has joined #RubyOnRails
[13:43:09] gheegh: has joined #ruby
[16:45:14] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[20:34:41] gheegh: has joined #RubyOnRails
[20:34:41] gheegh: has joined #ruby
[21:09:18] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[21:12:36] gheegh: has joined #RubyOnRails
[21:12:48] gheegh: has joined #ruby
[21:40:08] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[21:40:55] gheegh: has joined #ruby
[21:41:06] gheegh: has joined #RubyOnRails
[21:52:48] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[21:58:24] gheegh: has joined #RubyOnRails
[21:58:29] gheegh: has joined #ruby
[22:10:59] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…

2018-07-21

[12:44:36] gheegh: has joined #RubyOnRails
[12:44:36] gheegh: has joined #ruby
[17:26:17] gheegh: Ping timeout: 276 seconds

2018-07-20

[22:16:16] gheegh: has joined #RubyOnRails
[22:16:16] gheegh: has joined #ruby
[23:22:38] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…

2018-07-02

[00:21:12] gheegh: Quit: Textual IRC Client: www.textualapp.com

2018-07-01

[19:46:33] gheegh: has joined #ruby
[19:46:33] gheegh: has joined #RubyOnRails
[19:49:31] gheegh: compressable, deployable to Heroku.. anyone have any thoughts?
[19:49:31] gheegh: hey all.. question. I'm using Moneta to bulid a simple gem that looks up/loads a file that's about 800MB uncompressed. I am storing it on Github, so I need to break it into smaller file sizes. I had loaded it into several small SQL files, but that's not supported on Heroku. The File store breaks each key into its own file, adding about 400,000 files to the github repo (not a great idea for performance). I need something smaller,
[22:44:40] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[23:09:48] gheegh: has joined #RubyOnRails
[23:09:48] gheegh: has joined #ruby

2018-06-27

[11:12:30] gheegh: Ping timeout: 260 seconds

2018-06-26

[16:25:50] gheegh: has joined #RubyOnRails
[16:25:56] gheegh: has joined #ruby
[16:26:43] gheegh: Hey all, anyone have a good, reliable config for using StatsD with ActiveJob? It seems my stats are not getting sent reliably.
[16:26:56] gheegh: using sidekiq as an adapter

2018-06-25

[15:54:19] gheegh: Quit: My MacBook has gone to sleep. ZZZzzz…
[17:21:31] gheegh: has joined #RubyOnRails
[17:21:31] gheegh: has joined #ruby
[18:40:41] gheegh: Quit: Textual IRC Client: www.textualapp.com

2018-06-24

[15:25:50] gheegh: i'll play with it.. thanks
[15:29:28] gheegh: the thought was to limit IO
[15:29:42] gheegh: and break it into a lot of smaller files
[15:30:43] gheegh: I'll try all o the options
[15:30:55] gheegh: i really just want to retrieve 1 record at a shot
[15:31:06] gheegh: and have the minimal amount of IO and memory used
[15:31:18] gheegh: and disk to a lesser extent
[15:31:28] gheegh: ok.. i'll try them
[15:31:31] gheegh: thanks guys
[15:33:45] gheegh: ok.. that's great
[15:33:50] gheegh: super helpful
[15:36:55] gheegh: i'll write up something like that gist.. and see what happens
[15:38:39] gheegh: essentailly, I'll be checking the database into the repo.. so the problem with DBM is it's machine dependent.
[15:38:50] gheegh: this will be running (eventually) on a couple dozen machines
[15:39:46] gheegh: yeah i'll try taht one first..
[15:47:26] gheegh: leveldb's bindings for ruby are pretty non-functioanl on Ruby 2.5.1 on a mac
[15:54:39] gheegh: yeah, don't have time to work on that.. :-)
[15:55:37] gheegh: that's what I"m working on now
[15:57:49] gheegh: I would love to be thinking in those terms.. too much going on right now.. i'm elbow deep in todos.. :-)
[15:59:19] gheegh: i will say sqlite is loading a lot slower.. :-)
[16:10:05] gheegh: FYI.. sqlite expanded the file from 490 MB to about 600 MB
[16:20:09] gheegh: wrapping with moneta, and using a compressions transformer
[16:28:59] gheegh: compressing the file reduces it to 239 MB
[16:29:10] gheegh: still too big to store on Github