#ipfs on 2016-06-29 — irc logs at freenode.irclog.whitequark.org

2016-06-16 18:15 Kubuxu changed the topic of #ipfs to: Update to v0.4.2, the v03x network's EOL/end-of-life approaches: June 30th -- IPFS - InterPlanetary File System -- https://git.io/vVBS8 -- FAQ: https://git.io/voEh8 -- Channel logs: https://botbot.me/freenode/ipfs/ -- Code of Conduct: https://git.io/vVBS0 -- Sprints: https://git.io/voEAh

00:00 <apiarian> nice. well i'm heading off. whyrusleeping did you see that twin link in webui issue?

00:04 <whyrusleeping> apiarian: i didnt yet

00:04 <whyrusleeping> i dont normally pay close attention to the webui, i make dignifiedquire handle that :P

00:05 <apiarian> cool

00:05 <apiarian> ya i took a look in there and remembered why i'm an api dev

00:07 computerfreak has quit [Quit: Leaving.]

00:15 gmcquillan_ has quit [Ping timeout: 260 seconds]

00:18 cketti has joined #ipfs

00:22 pguth has quit [Remote host closed the connection]

00:23 pguth has joined #ipfs

00:24 ZaZ has quit [Quit: Leaving]

00:53 cketti has quit [Quit: Leaving]

00:59 Kane` has joined #ipfs

01:00 galois_d_ has quit [Remote host closed the connection]

01:01 galois_dmz has joined #ipfs

01:02 wallacoloo has joined #ipfs

01:04 galois_d_ has joined #ipfs

01:07 galois_dmz has quit [Ping timeout: 258 seconds]

01:11 bsm117532 has quit [Killed (verne.freenode.net (Nickname regained by services))]

01:12 bsm1175321 has joined #ipfs

01:15 pfista has joined #ipfs

01:17 apiarian has quit [Ping timeout: 240 seconds]

01:20 apiarian has joined #ipfs

01:24 jbenet_train has joined #ipfs

01:29 herzmeister has quit [Quit: Leaving]

01:29 wallacoloo has quit [Read error: Connection reset by peer]

01:30 herzmeister has joined #ipfs

01:30 rgrinberg has joined #ipfs

01:34 harleyk_ is now known as harleyl

01:34 harleyl is now known as harleyk

01:36 pfista has quit [Ping timeout: 246 seconds]

01:44 reit has joined #ipfs

01:55 Kane` has quit [Remote host closed the connection]

01:56 bsm1175321 has quit [Remote host closed the connection]

01:58 Kane` has joined #ipfs

02:20 dmr has joined #ipfs

02:25 <jbenet_train> hey whyrusleeping, i think yes let's use a HAMT. here's the crap i was writing https://github.com/jbenet/ipld-ht-experiment -- look into ht.js and rht.js

02:27 pguth has quit [Remote host closed the connection]

02:27 pguth has joined #ipfs

02:35 Oatmeal has quit [Ping timeout: 246 seconds]

02:45 ygrek_ has quit [Ping timeout: 260 seconds]

02:58 chriscool has joined #ipfs

03:02 Oatmeal has joined #ipfs

03:05 <tmg> Q: Why are go-libp2p-peer* not included in go-libp2p?

03:06 <tmg> ...included is a bit ambiguous. Why are they in separate repos?

03:07 <jbenet_train> whyrusleeping, daviddias: https://github.com/ipfs/notes/issues/76#issuecomment-229244769

03:11 PrinceOfPeeves has quit [Quit: Leaving]

03:11 <whyrusleeping> tmg: so packages can use peer IDs without having to import go-ipfs or go-libp2p

03:11 <whyrusleeping> jbenet_train: sounds good

03:12 rardiol has quit [Ping timeout: 252 seconds]

03:15 <tmg> whyrusleeping: perhaps I misunderstand how go does importing

03:15 <tmg> does import ("io/outil") import all of "io" ?

03:15 pfista has joined #ipfs

03:24 chriscool has quit [Ping timeout: 260 seconds]

03:34 pfista has quit [Ping timeout: 260 seconds]

03:37 chriscool has joined #ipfs

03:40 chriscool has quit [Client Quit]

03:41 dmr has quit [Ping timeout: 250 seconds]

03:55 stoogenmeyer has quit [Remote host closed the connection]

04:06 <whyrusleeping> tmg: no, but the stdlib is special

04:07 <whyrusleeping> 'go get github.com/A/B/C' will clone all of github.com/A/B

04:12 pfista has joined #ipfs

04:13 jbenet_train has quit [Quit: leaving]

04:14 iNodezzz has quit [Ping timeout: 276 seconds]

04:39 Oatmeal has quit [Ping timeout: 244 seconds]

04:52 multivac has quit [Remote host closed the connection]

04:56 chungy has quit [Quit: ZNC - http://znc.in]

05:02 chungy has joined #ipfs

05:03 ashark has quit [Ping timeout: 260 seconds]

05:04 <kpcyrd> whyrusleeping: I ran into the issue again, `ipfs add` is stuck, with or without daemon running

05:04 <whyrusleeping> kpcyrd: what are you adding?

05:05 <kpcyrd> whyrusleeping: archlinux mirror

05:05 <kpcyrd> still :)

05:05 <whyrusleeping> are there any symlinks involved?

05:05 <kpcyrd> whyrusleeping: it got better with current master

05:05 <kpcyrd> whyrusleeping: there shouldn't, but I can check

05:05 Oatmeal has joined #ipfs

05:05 <kpcyrd> the files it's stuck on are regular files

05:06 <whyrusleeping> how large?

05:06 <kpcyrd> whyrusleeping: it seems to get slower the more I add

05:06 <whyrusleeping> hows memory usage?

05:06 <whyrusleeping> and whats the total size of the add?

05:06 <kpcyrd> it's currently stuck on a file that's 1.9 MB

05:06 <whyrusleeping> are we talking terabytes here?

05:07 <kpcyrd> 60 GB in total, partially added

05:07 <whyrusleeping> hrm... thats not huge

05:07 <kpcyrd> memory usage is 292M

05:07 <kpcyrd> on the daemon

05:07 <whyrusleeping> thats not bad either

05:07 <whyrusleeping> htm

05:07 <whyrusleeping> could i get a stack dump from the daemon while the add is stuck?

05:08 <kpcyrd> if you tell me how to do that :)

05:09 <kpcyrd> whyrusleeping: I'm also considering creating a droplet and reproduce it there, then give you access

05:09 <whyrusleeping> curl localhost:5001/debug/pprof/goroutine\?debug=2 > ipfs.stacks

05:09 Senji has quit [Ping timeout: 244 seconds]

05:11 Senji has joined #ipfs

05:14 <kpcyrd> whyrusleeping: https://gateway.ipfs.io/ipfs/QmSttszoWjyWyT12fBLZqQDgtHRYCKzE1gFt9M2itQtq3x

05:15 <whyrusleeping> kpcyrd: try killing your daemon, then

05:15 <whyrusleeping> running ipfs config --bool Datastore.NoSync true

05:15 <whyrusleeping> then restarting and retrying the add

05:16 <whyrusleeping> kpcyrd: aside from that, what filesystem are you using? and what type of disks?

05:16 <kpcyrd> whyrusleeping: btrfs, regular HDDs in raid

05:17 <whyrusleeping> interesting

05:17 <kpcyrd> nosync made it a lot faster

05:18 <whyrusleeping> did it complete?

05:18 <kpcyrd> not yet

05:18 <kpcyrd> 25800 / 65799

05:19 <kpcyrd> 26500 / 65799

05:21 <kpcyrd> whyrusleeping: it really looks like it's going to complete :)

05:21 <whyrusleeping> sweet

05:21 <whyrusleeping> the stack trace just looked like the fsync syscalls were taking ages

05:23 rgrinberg has quit [Ping timeout: 260 seconds]

05:24 <kpcyrd> getting closer to 50%

05:30 iNodezzz has joined #ipfs

05:45 thufir has joined #ipfs

06:01 meadman has quit [Read error: Connection reset by peer]

06:01 diffalot_ has quit [Remote host closed the connection]

06:01 meadman has joined #ipfs

06:02 diffalot has joined #ipfs

06:13 matoro has quit [Ping timeout: 260 seconds]

06:16 tmg has quit [Ping timeout: 260 seconds]

06:19 matoro has joined #ipfs

06:22 mildred has joined #ipfs

06:42 pfista has quit [Ping timeout: 250 seconds]

06:49 corvinux has joined #ipfs

06:56 ylp has joined #ipfs

07:09 Tv` has quit [Quit: Connection closed for inactivity]

07:14 Kane` has quit [Remote host closed the connection]

07:16 zorglub27 has joined #ipfs

07:18 reit has quit [Ping timeout: 244 seconds]

07:20 ashark has joined #ipfs

07:24 mildred has quit [Remote host closed the connection]

07:24 ashark has quit [Ping timeout: 240 seconds]

07:25 <kpcyrd> whyrusleeping: it got slower again, looks like my disk is the bottleneck

07:25 <kpcyrd> whyrusleeping: ipfs add is also slower if you execute one add per file

07:26 mildred has joined #ipfs

07:26 <kpcyrd> around 1min for < 1 KB

07:26 <kpcyrd> stacktrace says it's syncing

07:27 Akaibu has quit [Quit: Connection closed for inactivity]

07:31 pguth has quit [Remote host closed the connection]

07:32 pguth has joined #ipfs

07:35 palkeo has joined #ipfs

07:38 Akaibu has joined #ipfs

07:39 pfista has joined #ipfs

07:41 <kpcyrd> whyrusleeping: `ipfs daemon --offline` improves speed dramatically

07:43 s_kunk has quit [Ping timeout: 246 seconds]

08:13 s_kunk has joined #ipfs

08:14 ianopolous has quit [Ping timeout: 264 seconds]

08:14 chriscool has joined #ipfs

08:15 ashark has joined #ipfs

08:18 s_kunk has quit [Quit: Read error: Connection reset by beer]

08:18 s_kunk has joined #ipfs

08:19 ashark has quit [Ping timeout: 244 seconds]

08:22 Boomerang has joined #ipfs

08:23 tmg has joined #ipfs

08:23 palkeo has quit [Quit: Konversation terminated!]

08:23 tmg has quit [Changing host]

08:23 tmg has joined #ipfs

08:28 pfista has quit [Ping timeout: 244 seconds]

08:31 pfista has joined #ipfs

08:36 rendar has joined #ipfs

08:57 pguth has quit [Remote host closed the connection]

08:57 pguth has joined #ipfs

09:01 chriscool1 has joined #ipfs

09:01 chriscool has quit [Quit: Leaving.]

09:02 tmg has quit [Ping timeout: 244 seconds]

09:05 pguth has quit [Remote host closed the connection]

09:05 pguth has joined #ipfs

09:08 chriscool1 has quit [Quit: Leaving.]

09:09 chriscool has joined #ipfs

09:15 pguth has quit [Remote host closed the connection]

09:15 pguth has joined #ipfs

09:17 chriscool has quit [Quit: Leaving.]

09:28 espadrine has joined #ipfs

09:38 <richardlitt> morning.

09:39 espadrine has quit [Ping timeout: 258 seconds]

09:45 Arakela007 has joined #ipfs

09:45 espadrine has joined #ipfs

09:47 jl is now known as demize

09:49 espadrine has quit [Read error: Connection reset by peer]

10:04 disgusting_wall has quit [Quit: Connection closed for inactivity]

10:04 corvinux has quit [Ping timeout: 258 seconds]

10:16 sivachandran has joined #ipfs

10:18 cemerick has joined #ipfs

10:19 Encrypt has joined #ipfs

10:25 computerfreak has joined #ipfs

10:27 computerfreak has quit [Client Quit]

10:27 nonaTure has joined #ipfs

10:36 apiarian has quit [Ping timeout: 272 seconds]

10:37 sivachandran has quit [Remote host closed the connection]

10:38 apiarian has joined #ipfs

10:41 tmg has joined #ipfs

10:44 <sevcsik> hi all, ipfs daemon runs out of memory on my 2GB box regularly. is this a memory leak, or normal behaviour?

10:45 <slothbag> pretty normal sevcsik, I think the devs are working hard to reduce this though

10:45 <sevcsik> great, thanks

10:57 Akaibu has quit [Quit: Connection closed for inactivity]

11:00 <daviddias> Kubuxu: are you around?

11:01 <daviddias> are you familiar with the mfs code in go-ipfs?

11:03 corvinux has joined #ipfs

11:05 corvinux has quit [Remote host closed the connection]

11:06 ashark has joined #ipfs

11:07 corvinux has joined #ipfs

11:09 corvinux has quit [Remote host closed the connection]

11:10 ashark has quit [Ping timeout: 244 seconds]

11:14 corvinux has joined #ipfs

11:14 corvinux has quit [Remote host closed the connection]

11:19 sivachandran has joined #ipfs

11:23 corvinux has joined #ipfs

11:32 corvinux has quit [Quit: Leaving]

11:38 corvinux has joined #ipfs

11:41 corvinux has quit [Remote host closed the connection]

11:42 corvinux has joined #ipfs

11:44 corvinux has quit [Client Quit]

11:48 martinkl_ has joined #ipfs

11:55 sivachan_ has joined #ipfs

11:57 sivachandran has quit [Ping timeout: 272 seconds]

11:59 sivachandran has joined #ipfs

12:00 sivachan_ has quit [Ping timeout: 252 seconds]

12:01 pguth has quit [Remote host closed the connection]

12:02 pguth has joined #ipfs

12:04 zorglub27 has quit [Ping timeout: 250 seconds]

12:11 cemerick has quit [Ping timeout: 264 seconds]

12:12 Oatmeal has quit [Ping timeout: 240 seconds]

12:22 corvinux has joined #ipfs

12:22 herzmeister has quit [Quit: Leaving]

12:23 herzmeister has joined #ipfs

12:24 cemerick has joined #ipfs

12:25 martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]

12:29 martinkl_ has joined #ipfs

12:33 ashark has joined #ipfs

12:33 corvinux has quit [Ping timeout: 260 seconds]

12:35 robin[m] has joined #ipfs

12:36 <robin[m]> Hi

12:38 Encrypt has quit [Quit: And now... eating time!]

12:39 Oatmeal has joined #ipfs

12:39 ashark has quit [Ping timeout: 252 seconds]

12:41 achin has quit [Changing host]

12:41 achin has joined #ipfs

12:42 cemerick has quit [Ping timeout: 240 seconds]

12:47 cemerick has joined #ipfs

12:49 ashark has joined #ipfs

12:49 stoogenmeyer has joined #ipfs

12:56 PrinceOfPeeves has joined #ipfs

12:56 rgrinberg has joined #ipfs

13:00 martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]

13:00 pguth has quit [Remote host closed the connection]

13:00 pguth has joined #ipfs

13:04 herzmeister has quit [Quit: Leaving]

13:04 ruby32 has joined #ipfs

13:04 herzmeister has joined #ipfs

13:10 nonaTure has quit [Ping timeout: 240 seconds]

13:18 __uguu__ has joined #ipfs

13:22 martinkl_ has joined #ipfs

13:24 dignifiedquire has joined #ipfs

13:26 ashark has quit [Ping timeout: 258 seconds]

13:37 rardiol has joined #ipfs

13:39 Encrypt has joined #ipfs

13:51 ruby32 has quit [Ping timeout: 250 seconds]

13:52 tmg has quit [Ping timeout: 260 seconds]

13:59 slothbag has quit [Quit: Leaving.]

14:00 pguth has quit [Remote host closed the connection]

14:00 pguth has joined #ipfs

14:05 pguth has quit [Remote host closed the connection]

14:05 pguth has joined #ipfs

14:05 ruby32 has joined #ipfs

14:05 stoogenmeyer has quit [Remote host closed the connection]

14:09 ashark has joined #ipfs

14:11 sivachandran has quit [Remote host closed the connection]

14:12 pguth has quit [Remote host closed the connection]

14:12 pguth has joined #ipfs

14:13 sydbarrett74 has joined #ipfs

14:16 stoogenmeyer has joined #ipfs

14:25 chriscool1 has joined #ipfs

14:25 splintax has quit [Ping timeout: 250 seconds]

14:26 splintax has joined #ipfs

14:32 cmeik has joined #ipfs

14:32 stoogenmeyer has quit [Remote host closed the connection]

14:34 stoogenmeyer has joined #ipfs

14:36 dmr has joined #ipfs

14:37 pguth has quit [Remote host closed the connection]

14:37 pguth has joined #ipfs

14:39 stoogenmeyer has quit [Ping timeout: 260 seconds]

14:41 nonaTure has joined #ipfs

14:43 stoogenmeyer has joined #ipfs

14:44 reit has joined #ipfs

15:06 rardiol has quit [Ping timeout: 276 seconds]

15:11 ylp has quit [Quit: Leaving.]

15:14 taaem has quit [Read error: Connection reset by peer]

15:17 sevcsik has quit [Quit: ZNC - http://znc.in]

15:22 mildred has quit [Quit: Leaving.]

15:30 sevcsik has joined #ipfs

15:31 dignifiedquire has quit [Quit: Connection closed for inactivity]

15:44 <Kubuxu> daviddias: I am not avaliable today for two more hours.

15:45 stoogenmeyer has quit [Remote host closed the connection]

15:45 <Kubuxu> sevcsik: we've fixed 3 memory leaks since 4 w

15:46 <Kubuxu> ... 0.4.2, we expect things to get much better in 0.4.3

15:46 nonaTure has quit [Ping timeout: 276 seconds]

15:47 stoogenmeyer has joined #ipfs

15:47 nonaTure has joined #ipfs

15:50 pguth has quit [Remote host closed the connection]

15:50 pguth has joined #ipfs

15:53 <sevcsik> Kubuxu: cheers

15:57 nonaTure has quit [Ping timeout: 246 seconds]

15:58 ygrek_ has joined #ipfs

16:02 wking has quit [Ping timeout: 260 seconds]

16:09 nonaTure has joined #ipfs

16:09 ashark_ has joined #ipfs

16:10 stoogenmeyer has quit [Remote host closed the connection]

16:11 wking has joined #ipfs

16:14 ashark_ has quit [Ping timeout: 252 seconds]

16:14 ygrek_ has quit [Ping timeout: 244 seconds]

16:21 <whyrusleeping> daviddias: wassup

16:52 chriscool1 has quit [Ping timeout: 260 seconds]

16:52 Encrypt has quit [Read error: Connection reset by peer]

16:53 Encrypt has joined #ipfs

16:55 <ipfsbot> [js-ipfs] diasdavid created update-roadmap (+3 new commits): https://git.io/voN1c

16:55 <ipfsbot> js-ipfs/update-roadmap 4c7a9e8 David Dias: fix externals for simple-websocket-server

16:55 <ipfsbot> js-ipfs/update-roadmap ef0d2ef David Dias: scripts for isolated tests

16:55 <ipfsbot> js-ipfs/update-roadmap 663f809 David Dias: update the roadmap

16:56 <ipfsbot> [js-ipfs] diasdavid opened pull request #338: Update roadmap (master...update-roadmap) https://git.io/voN10

16:56 Foxcool has quit [Ping timeout: 276 seconds]

16:57 <ipfsbot> [js-ipfs] diasdavid pushed 1 new commit to master: https://git.io/voN1g

16:57 <ipfsbot> js-ipfs/master d2b1c35 David Dias: Merge pull request #338 from ipfs/update-roadmap...

16:57 <ipfsbot> [js-ipfs] diasdavid deleted greenkeeper-ipfs-unixfs-engine-0.10.0 at 706180b: https://git.io/voN1o

16:57 s_kunk has quit [Ping timeout: 272 seconds]

16:57 <ipfsbot> [js-ipfs] diasdavid force-pushed greenkeeper-joi-8.4.2 from b3ad0b3 to 97b8a89: https://git.io/voN1M

16:57 <ipfsbot> js-ipfs/greenkeeper-joi-8.4.2 97b8a89 greenkeeperio-bot: chore(package): update joi to version 8.4.2...

17:00 <ipfsbot> [js-ipfs] diasdavid pushed 2 new commits to master: https://git.io/voNMC

17:00 <ipfsbot> js-ipfs/master 92c1676 David Dias: chore: update contributors

17:00 <ipfsbot> js-ipfs/master 76bf64d David Dias: chore: release version v0.14.1

17:00 Foxcool has joined #ipfs

17:03 arpu has quit [Ping timeout: 252 seconds]

17:04 ashark_ has joined #ipfs

17:05 meadman has quit [Ping timeout: 276 seconds]

17:05 <daviddias> whyrusleeping: hey o/

17:06 <daviddias> whyrusleeping: how is it going?

17:06 <daviddias> did you see my issue on https://github.com/ipfs/go-ipfs/issues/2918

17:06 <whyrusleeping> goin pretty good, been working on migrations all morning

17:06 <whyrusleeping> havent seen that issue yet

17:07 <daviddias> ah nice, didn't realise that the base32 thing was happening so soon

17:08 <whyrusleeping> yeap, its shipping with 0.4.3

17:08 ashark_ has quit [Ping timeout: 246 seconds]

17:10 <whyrusleeping> daviddias: i responded to your issue

17:10 <whyrusleeping> but if you want to do more realtime debugging i'm down for that too

17:11 stoogenmeyer has joined #ipfs

17:12 meadman has joined #ipfs

17:13 <daviddias> I'm too

17:13 <daviddias> zoom zoom?

17:13 <whyrusleeping> i dont drive a mazda, but sure

17:15 <daviddias> let's go with hangouts then, so that if more people want to join, they can https://hangouts.google.com/hangouts/_/daviddias.me/npm-on-ipfs

17:15 gmcquillan has joined #ipfs

17:15 arpu has joined #ipfs

17:15 gmcquillan is now known as gmcquillan_

17:15 stoogenmeyer has quit [Ping timeout: 244 seconds]

17:15 bsm1175321 has joined #ipfs

17:16 <whyrusleeping> requesting to join!

17:16 bsm1175321 is now known as bsm117532

17:17 bsm117532 has left #ipfs [#ipfs]

17:33 stoogenmeyer has joined #ipfs

17:35 pguth has quit [Remote host closed the connection]

17:36 pguth has joined #ipfs

17:37 <whyrusleeping> https://github.com/hapijs/wreck/issues/20

17:37 ygrek_ has joined #ipfs

17:40 s_kunk has joined #ipfs

17:46 ylp has joined #ipfs

17:51 <daviddias> whyrusleeping: https://github.com/ipfs/js-ipfs-api/blob/master/src/cmd-helpers.js

17:51 <daviddias> whyrusleeping: then https://github.com/ipfs/js-ipfs-api/blob/master/src/request-api.js

17:55 <daviddias> whyrusleeping: https://github.com/ipfs/js-ipfs-api/blob/master/src/index.js#L40

18:03 disgusting_wall has joined #ipfs

18:12 nonaTure has quit [Ping timeout: 276 seconds]

18:15 palkeo has joined #ipfs

18:15 palkeo has quit [Changing host]

18:26 stoogenmeyer has quit [Remote host closed the connection]

18:26 erde74 has joined #ipfs

18:33 ianopolous has joined #ipfs

18:34 stoogenmeyer has joined #ipfs

18:45 ylp has quit [Ping timeout: 260 seconds]

18:45 pguth has quit [Remote host closed the connection]

18:45 ylp has joined #ipfs

18:45 pguth has joined #ipfs

18:54 martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]

19:00 [tymat] has joined #ipfs

19:02 tymat has quit [Ping timeout: 244 seconds]

19:02 MJRider has quit [Ping timeout: 244 seconds]

19:02 MJRider has joined #ipfs

19:02 mpierce has joined #ipfs

19:03 livegnik has quit [Ping timeout: 244 seconds]

19:04 livegnik has joined #ipfs

19:08 ashark_ has joined #ipfs

19:13 Encrypt has quit [Quit: Quitte]

19:14 ashark_ has quit [Ping timeout: 276 seconds]

19:14 bsm117532 has joined #ipfs

19:16 martinkl_ has joined #ipfs

19:18 Boomerang has quit [Quit: Lost terminal]

19:19 reit has quit [Ping timeout: 258 seconds]

19:20 arpu has quit [Remote host closed the connection]

19:20 martinkl_ has quit [Client Quit]

19:23 dmr has quit [Ping timeout: 250 seconds]

19:27 flobs has joined #ipfs

19:41 cemerick has quit [Ping timeout: 240 seconds]

19:46 stoogenmeyer has quit [Remote host closed the connection]

19:49 pguth has quit [Remote host closed the connection]

19:49 pguth has joined #ipfs

19:54 pguth has quit [Remote host closed the connection]

19:54 pguth has joined #ipfs

19:58 Encrypt has joined #ipfs

20:03 mildred has joined #ipfs

20:11 Tv` has joined #ipfs

20:13 stoogenmeyer has joined #ipfs

20:15 em-ly has joined #ipfs

20:18 erde74 has quit [Quit: Verlassend]

20:21 martinkl_ has joined #ipfs

20:26 dignifiedquire has joined #ipfs

20:27 zootella has joined #ipfs

20:29 zootella has quit [Client Quit]

20:33 jaboja has joined #ipfs

20:37 chriscool has joined #ipfs

20:38 rendar has quit [Ping timeout: 244 seconds]

20:46 <kevina> whyrusleeping: If your curious about Query performance have a look at my graphs at: https://github.com/ipfs/go-datastore/issues/40

20:47 chriscool has quit [Quit: Leaving.]

20:51 <whyrusleeping> kevina: i saw that

20:51 <whyrusleeping> it looks like we can get some nice gains from buffering

20:52 <kevina> (note: I edited my comment to include results from flatfs in case you missed it)

20:52 <whyrusleeping> nice!

20:52 <kevina> I am thinking at very least we should set the buffer size to 128 for key only queries.

20:52 <whyrusleeping> agreed

20:53 <kevina> Seeing how much performance we can get from a direct iterator on flatfs.

20:54 <kevina> The flatfs using two Goroutines and two channels.

20:54 <kevina> make that the flatfs query uses two Goroutines and two channels

20:55 ralphtheninja has joined #ipfs

20:56 computerfreak has joined #ipfs

20:56 ylp has quit [Ping timeout: 260 seconds]

20:59 ylp has joined #ipfs

21:03 stoogenmeyer has quit [Remote host closed the connection]

21:04 taaem has joined #ipfs

21:08 rendar has joined #ipfs

21:09 ylp has quit [Ping timeout: 260 seconds]

21:10 chip_ has joined #ipfs

21:13 ylp has joined #ipfs

21:14 meadman has quit [Ping timeout: 260 seconds]

21:15 mildred has quit [Read error: Connection reset by peer]

21:18 mildred has joined #ipfs

21:21 meadman has joined #ipfs

21:21 chip_ has quit [Ping timeout: 250 seconds]

21:24 mildred has quit [Ping timeout: 250 seconds]

21:27 martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]

21:36 ashark_ has joined #ipfs

21:40 ashark_ has quit [Ping timeout: 246 seconds]

21:41 <Codebird> fail fail fail fail fail fail fail fail fail fail... this could be going better. So much old stuff on IPFS that can no longer be retrieved.

21:42 <Codebird> The curious thing is that most of it, I can get directories, but not the files within.

21:44 disgusting_wall has quit [Quit: Connection closed for inactivity]

21:48 ylp has quit [Ping timeout: 260 seconds]

21:50 ylp has joined #ipfs

21:55 pguth has quit [Remote host closed the connection]

21:55 pguth has joined #ipfs

21:58 zootella has joined #ipfs

22:00 pguth has quit [Remote host closed the connection]

22:00 pguth has joined #ipfs

22:04 ylp has quit [Ping timeout: 260 seconds]

22:04 taaem has quit [Ping timeout: 240 seconds]

22:05 <whyrusleeping> Codebird: what version of ipfs?

22:05 ylp has joined #ipfs

22:06 <Codebird> 0.4.2

22:06 <whyrusleeping> what content are you trying to get?

22:06 <whyrusleeping> maybe its all on the 0.3.X network?

22:06 <whyrusleeping> and the people hosting it havent upgraded yet

22:07 <Codebird> Most likely, yes.

22:07 <Codebird> And pretty much all of it. I'm gathering data for indexing.

22:07 <whyrusleeping> ah, gotcha

22:08 <Codebird> I found a couple of pages that contained indexes of IPFS sites, crawled from there.

22:09 <Codebird> There's a ton of copyright-infringing content. Fortunately, none of it is fetchable.

22:09 ashark has quit [Ping timeout: 244 seconds]

22:10 ylp has quit [Ping timeout: 260 seconds]

22:18 ylp has joined #ipfs

22:25 bsm117532 has quit [Remote host closed the connection]

22:27 Arakela007 has quit [Remote host closed the connection]

22:31 dignifiedquire has quit [Quit: Connection closed for inactivity]

22:32 rgrinberg has quit [Ping timeout: 246 seconds]

22:38 Encrypt has quit [Quit: Quitte]

22:43 sydbarrett74 has quit [Ping timeout: 240 seconds]

22:44 pguth has quit [Remote host closed the connection]

22:44 pguth has joined #ipfs

22:50 cemerick has joined #ipfs

22:51 ruby32 has quit [Remote host closed the connection]

22:52 <achin> how can you tell it's copyright-infringing without seeing the content? based on the file names, perhaps?

22:53 stoogenmeyer has joined #ipfs

22:56 cemerick has quit [Ping timeout: 276 seconds]

23:01 stoogenmeyer has quit [Remote host closed the connection]

23:05 ashark has joined #ipfs

23:07 stoogenmeyer has joined #ipfs

23:07 jaboja has quit [Remote host closed the connection]

23:09 slothbag has joined #ipfs

23:11 zootella has quit [Quit: zootella]

23:12 Senji has quit [Ping timeout: 276 seconds]

23:13 zootella has joined #ipfs

23:16 zootella has quit [Client Quit]

23:19 palkeo has quit [Quit: Konversation terminated!]

23:27 rendar has quit [Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!]

23:28 tmg has joined #ipfs

23:28 <kyledrake> So... a IPFS node with tens of thousands of IPNS keys...

23:29 zootella has joined #ipfs

23:47 matoro has quit [Ping timeout: 264 seconds]

23:49 cketti has joined #ipfs

23:56 matoro has joined #ipfs

23:57 rgrinberg has joined #ipfs

23:59 stoogenm_ has joined #ipfs

23:59 zootella has quit [Quit: zootella]