<xioustic>
in that case, yes, unmarshal should do what you want (remove those ugly bytes or at least parse them into something usable; that protobuf)
<pfraze>
xioustic: yeah that's looking to be the case
<xioustic>
just guesses; i have historically wondered that
<xioustic>
i asked Juan at IA about what is the diff between files/dirs and raw DAG nodes hoping to get at that (IPLD talk), but couldn't really point it to that. too specific for the context. so that's the digging i did.
<xioustic>
hey; i was thinking about wrapping go-ipfs binary with a single-file executable, cross-platform file explorer built in PyQt. maybe call it IPFS-Explorer or something; it'd be a desktop client, not javascripty. is work on that already being done to anyone's knowledge?
gmcquillan has joined #ipfs
<lgierth>
pfraze: it's fs:/ipfs :D
<deltab>
there's no metadata that marks the object/block/whatever as being protobuf vs. whatever?
<lgierth>
we had the mother of all discussions about it on github
<lgierth>
tl;dr there's no origin, so the uri has no authority/host
<pfraze>
lgierth: hmm! well, i may have to stir the pot on that a little bit
<pfraze>
lgierth: thanks, was just going to ask for that
<pfraze>
I'll give it a read
<lgierth>
the basic idea is that /ipfs and /ipns are just two things in the interplanetary file system namespace
<pfraze>
yeah
ryjen has joined #ipfs
matoro has quit [Ping timeout: 260 seconds]
<xioustic>
anyone work on putting a Bitcoin Blockchain explorer into IPFS? that's the other project I had already started on aside from the IPFS-Explorer idea. wondering if there's any overlap with anyone's work?
matoro has joined #ipfs
ryjen has quit [Ping timeout: 252 seconds]
ryjen has joined #ipfs
stoogenmeyer has quit [Remote host closed the connection]
stoogenmeyer has joined #ipfs
ryjen has quit [Ping timeout: 252 seconds]
gmcquillan has quit [Quit: gmcquillan]
ryjen has joined #ipfs
apiarian has quit [Quit: zoom]
deltab has quit [Quit: Changing server]
pfista has quit [Read error: Connection reset by peer]
pfista has joined #ipfs
deltab has joined #ipfs
matoro has quit [Ping timeout: 250 seconds]
bpcamac has joined #ipfs
reit has joined #ipfs
bpcamac has quit [Ping timeout: 258 seconds]
stoogenmeyer has quit [Remote host closed the connection]
matoro has joined #ipfs
stoogenmeyer has joined #ipfs
<M-sokoow>
Xioustc, do you have it on github?
stoogenmeyer has quit [Remote host closed the connection]
stoogenmeyer has joined #ipfs
stoogenm_ has joined #ipfs
pfista has quit [Ping timeout: 244 seconds]
stoogenmeyer has quit [Ping timeout: 246 seconds]
Kane` has joined #ipfs
computerfreak has quit [Quit: Leaving.]
zorglub27 has quit [Quit: zorglub27]
ryjen has quit [Ping timeout: 252 seconds]
wallacoloo has quit [Ping timeout: 250 seconds]
ryjen has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
MahaDev has quit [Remote host closed the connection]
mgue has quit [Ping timeout: 264 seconds]
pfista has joined #ipfs
pfista has quit [Ping timeout: 258 seconds]
pfista has joined #ipfs
mgue has joined #ipfs
stoopkid has quit [Ping timeout: 246 seconds]
stoopkid has joined #ipfs
pfista has quit [Ping timeout: 276 seconds]
matoro has quit [Ping timeout: 250 seconds]
pfista has joined #ipfs
matoro has joined #ipfs
matoro has quit [Ping timeout: 252 seconds]
M-pfista has joined #ipfs
<ipfsbot>
[go-ipfs] whyrusleeping pushed 8 new commits to master: https://git.io/vocmf
<ipfsbot>
go-ipfs/master 6217e1f Jakub Sztandera: Remove go-datastore from Godeps...
<ipfsbot>
go-ipfs/master cafd81c Jakub Sztandera: Import go-datastore to gx...
<ipfsbot>
go-ipfs/master 7910c6e Jakub Sztandera: Remove snappy from Godeps...
mgue has quit [Quit: WeeChat 1.5]
wallacoloo has joined #ipfs
mgue has joined #ipfs
_rht has joined #ipfs
wallacoloo has quit [Quit: wallacoloo]
pfista has quit [Read error: Connection reset by peer]
pfista has joined #ipfs
<A124>
whyrusleeping Why don't you merge ipfs-key ? and there are two issues, one solved if you mereg.
matoro has joined #ipfs
pfista has quit [Ping timeout: 244 seconds]
PrinceOfPeeves has quit [Quit: Leaving]
stoogenm_ has quit [Remote host closed the connection]
stoogenmeyer has joined #ipfs
stoogenmeyer has quit [Ping timeout: 258 seconds]
reit has quit [Ping timeout: 260 seconds]
cketti has quit [Quit: Leaving]
ashark has joined #ipfs
dignifiedquire has quit [Quit: Connection closed for inactivity]
M-jimt has joined #ipfs
ashark has quit [Ping timeout: 240 seconds]
M-kcinjp has joined #ipfs
dmr has quit [Ping timeout: 250 seconds]
reit has joined #ipfs
ryjen has quit [Ping timeout: 252 seconds]
<Kubuxu>
xioustic: nobody I know of does Btc explorer on IPFS, it would be awesome.
<A124>
Kubuxu What is BTC explorer even?
* A124
knows the blockchain, I meant what it does visualize.
<Kubuxu>
Allows you to check balances, transactions, block content and so on.
<A124>
Neat. Yeah, if implemented well that would be neat.
<A124>
Kubuxu I am not sure what is your position as a role in the management of ipfs code and actions. If you could clarify, that would help. But I think the following does concern you.
<A124>
jbenet, not sure who this also concerns, please delegate. We were iterating with a creator of another "internet filesystem" and we came into conclusion that protobuf is handy for transport any everything else, but that there is one missing layer, that is effectively squeezed into nonexistence. Addressability of raw data, without the wrapper. There should be a layer of content adressability [...]
<A124>
[...] present. As illustrated by (omitt the key k, in this case) https://ipfs.io/ipfs/QmSSrLmuf6jHsbVHunaBnteGFewuykuQS9eu2riosxCwaq IPFS does expose h(r3), h(r4), only h(r0) h(r1) h(r2). This does limit interoperability and creates further management complexity in certain scenarios.
<A124>
kevina, as you are working on filestore, which is currently this "interoperability layer", I guess that concerns you also.
<A124>
Kubuxu Found that, reading, I was not around much for the past three days. But still, can you please point me to the part that does relate to raw data addressability? aka content_link = h(data)
<A124>
Where data is a chunk of file of chunk_size, unless it is the last chunk. Same stuff just splitting apart the protobuf and the data itself and make those adressable by hash of the data.
<M-davidar>
(as well as the individual chunks of larger files)
Shutoku has quit [Ping timeout: 276 seconds]
<Kubuxu>
M-davidar: but is the multicodec included at the begging of the binary blob?
<vandemar>
is there a way to avoid moving files into the ipfs database and still make them accessible over ipfs? Tell ipfs to just hash some directory and store stub entries for those files?
<Kubuxu>
A124: it would be best if you raised your concerns on the ipfs/specs repo. Most of people working on the protocol are not really accessible on the IRC
M-prashere has joined #ipfs
<M-davidar>
Kubuxu: I had assumed that would be stored out-of-band (at least in the repo, perhaps not on the wire)
<M-davidar>
whyrusleeping: ^ ?
<A124>
Thanks, will take a look. Yes, that seems like that would do. Of course if the ability to publish file without a name (and of course attributes like mode, etc) would still be possible. If I understand right the content is the raw chunk, and content could also be array of the chunks?
<Kubuxu>
Yeah, because whole point of "raw" node is so that its hash is equal to the hash of data
<A124>
vandemar Yes, there is, checkout ipfs-filestore, it is in development.
<A124>
The files should not be modified or moved, else those would be unretrievable, of course.
<Kubuxu>
A124: I've seen it somewhere, can't tell you for sure, but specs repo should contain everything.
<A124>
M-davidar, yes, the purpose of that addressability is simple compatibility with any othr storage system that can provide hashes for raw data of chunk size equal to those on ipfs, while making very efficient storage (that could go a lot deeper, which the current state of things makes either complex or unstable, plus having to maintain specific ipfs compatibility).
unslate has joined #ipfs
<A124>
Kubuxu Yes, but for me it is of a challenge to find where is what and what should go where, to be honest. I work mostly on concepts and one man stuff / contributor.
rgrinberg has quit [Ping timeout: 260 seconds]
<A124>
Thanks to all for the concern and the replys.
M-prashere has left #ipfs ["User left"]
<vandemar>
Kubuxu: A124: cool. thanks, yeah, I realize there would be those constraints
herzmeister has quit [Ping timeout: 272 seconds]
ygrek_ has joined #ipfs
ecloud has quit [Ping timeout: 276 seconds]
M-Purple has joined #ipfs
corvinux has quit [Ping timeout: 240 seconds]
bpcamac has joined #ipfs
<kevina>
A124: I am not exactly following this conversation. What exactly concerns me?
M-Purple has left #ipfs [#ipfs]
<kevina>
Kubuxu: If you are still around, for now I just did a merge commit on https://github.com/ipfs/go-ipfs/pull/2634, I will rebase later and clean up my massive collection of commits.
<A124>
kevina Well, the filestore is a way to use files on disk. If content is addressed by data not protocol blocks, then it somewhat touches what you do.
<Kubuxu>
A124: yes but it wraps the data on the fly into the IPFS's format
<kevina>
Kubuxu: However continuous-integration/travis-ci/pr is failing, is looked like a gx dep problem....
ecloud has joined #ipfs
<Kubuxu>
I think go-log was updated to different hash
<Kubuxu>
you have to change the hash in the import statement
herzmeister has joined #ipfs
<kevina>
So why is teamcity and ci/circleci okay?
<Kubuxu>
No idea
<Kubuxu>
or maybe they cache gx directory
<Kubuxu>
then the package was there already
<kevina>
Okay so how do I fix the go-log import?
<Kubuxu>
Take a look at the hash of go-log inside the `package.json`
<Kubuxu>
update your hash with that
<kevina>
Kubuxu: Thanks. I just fixed it.
Oatmeal has joined #ipfs
konubinix has quit [Remote host closed the connection]
<kevina>
A124: It will only cause a problem if you try to add a file to the filestore that ends up not being encoded as a MerkleDag/Unixfs protobuf.
<kevina>
A124: It will fail fairly quickly when it tries decode the protocol buffer and fails.
<kevina>
A124: In any case this belongs in an issue when and if it comes up.
<kevina>
A124: But thanks for letting me know.
ryjen has joined #ipfs
ajp_ has joined #ipfs
ryjen has quit [Ping timeout: 252 seconds]
bpcamac has quit [Ping timeout: 240 seconds]
chriscool has joined #ipfs
computerfreak has joined #ipfs
mildred has joined #ipfs
dignifiedquire has joined #ipfs
<whyrusleeping>
alu: hey! can you link me to the janus in the website stuff?
<richardlitt>
Abandoned long distance hike after two days due to horrible midges (forgot how much they suck in Scotland), ended up hitching to the Outer Hebrides and hanging out there on the beach. Beautiful.
<richardlitt>
Ah, yes. This is one of my main things for this week - sorry for not getting to it before I leftr.
<Kubuxu>
yeah, we can, I do lot of things with gx in go-ipfs
_rht has quit [Quit: Connection closed for inactivity]
<richardlitt>
Added
corvinux has joined #ipfs
rgrinberg has joined #ipfs
rgrinberg has quit [Client Quit]
rgrinberg has joined #ipfs
pfista has joined #ipfs
ryjen has joined #ipfs
shyamsk has joined #ipfs
<ipfsbot>
[webui] greenkeeperio-bot opened pull request #398: Update chai-enzyme to version 0.5.0
pfista has quit [Ping timeout: 250 seconds]
ryjen has quit [Ping timeout: 252 seconds]
zz_r04r is now known as r04r
Encrypt has quit [Quit: Quitte]
cemerick has joined #ipfs
stoogenmeyer has joined #ipfs
ligi has joined #ipfs
cryptix has joined #ipfs
ligi_ has quit [Ping timeout: 240 seconds]
zorglub27 has quit [Remote host closed the connection]
computerfreak has joined #ipfs
<ipfsbot>
[go-ipfs] Kubuxu force-pushed feature/ls-stuck from 3972d99 to 399ff38: https://git.io/vo3FE
<ipfsbot>
go-ipfs/feature/ls-stuck d05d018 Jakub Sztandera: Disable resolving of the typ by default in ls...
<ipfsbot>
go-ipfs/feature/ls-stuck 399ff38 Jakub Sztandera: Make ipfs ls show type if it is avaliable locally...
zorglub27 has joined #ipfs
apiarian has joined #ipfs
ryjen has joined #ipfs
ryjen has quit [Ping timeout: 252 seconds]
cemerick has quit [Ping timeout: 244 seconds]
Encrypt has joined #ipfs
PrinceOfPeeves has joined #ipfs
cryptix has quit [Ping timeout: 244 seconds]
ryjen has joined #ipfs
cketti has quit [Quit: Leaving]
Kane` has quit [Remote host closed the connection]
ryjen has quit [Ping timeout: 252 seconds]
M-erwin has joined #ipfs
rardiol has joined #ipfs
stoogenmeyer has quit [Remote host closed the connection]
stoogenmeyer has joined #ipfs
Encrypt has quit [Quit: Quitte]
ryjen has joined #ipfs
ryjen has quit [Ping timeout: 252 seconds]
slothbag has quit [Quit: Leaving.]
corvinux has quit [Ping timeout: 260 seconds]
chungy has joined #ipfs
ylp1 has quit [Quit: Leaving.]
rmi7 has quit [Quit: I was using a Free IRC Bouncer from http://bnc4free.com (Account Removed)]
maxlath has joined #ipfs
ashark has joined #ipfs
ryjen has joined #ipfs
zorglub27 has quit [Ping timeout: 260 seconds]
maxlath is now known as zorglub27
Animazing has left #ipfs [#ipfs]
ashark_ has joined #ipfs
ryjen has quit [Ping timeout: 252 seconds]
ashark has quit [Ping timeout: 264 seconds]
stoogenmeyer has quit [Read error: Connection reset by peer]
stoogenmeyer has joined #ipfs
pfista has joined #ipfs
aluuu has joined #ipfs
seg_violation has quit [Remote host closed the connection]
cemerick has joined #ipfs
computerfreak has quit [Quit: Leaving.]
mildred has quit [Ping timeout: 258 seconds]
<noffle>
morning
<noffle>
richardlitt: welcome back!
<noffle>
logistics: is sync in 30m or 1h30m? also, is it a full-sync or short-sync?
<noffle>
since last week was tossed
<lgierth>
noffle: 2.5 hours, 6pm UTC
<lgierth>
and no sync at 4pm UTC
<Kubuxu>
There is no sync.
<lgierth>
Q2 Goals Review
<lgierth>
so this sprint is a 3 week sprint hehe
<Kubuxu>
Oh, there is sync, no sprint..
<lgierth>
oh
<lgierth>
right!
aluuu has quit [Quit: Bye]
<lgierth>
just pusing the hangouts to next week
<lgierth>
sorry
Akaibu has joined #ipfs
<Kubuxu>
but we might want to ask:
pfista has quit [Ping timeout: 244 seconds]
<Kubuxu>
daviddias, richardlitt: Is sync today at all?
<noffle>
Kubuxu: no, no sync at all (finally read my emails)
<Kubuxu>
ok
<Kubuxu>
lgierth: ^^
<lgierth>
ok
taaem has quit [Read error: Connection reset by peer]
Tv` has joined #ipfs
ola has joined #ipfs
pfista has joined #ipfs
rgrinberg has quit [Ping timeout: 244 seconds]
ylp has quit [Ping timeout: 264 seconds]
ylp has joined #ipfs
M-17739 has joined #ipfs
<M-17739>
test
cryptix has joined #ipfs
<noffle>
M-17739: works!
computerfreak has joined #ipfs
ryjen has joined #ipfs
affinitive has quit [Remote host closed the connection]
ryjen has quit [Ping timeout: 252 seconds]
computerfreak has quit [Quit: Leaving.]
reit has joined #ipfs
paragram has joined #ipfs
pfista has quit [Ping timeout: 250 seconds]
rgrinberg has joined #ipfs
vijayee_ has joined #ipfs
yosafbridge has quit [Ping timeout: 276 seconds]
s_kunk has quit [Ping timeout: 244 seconds]
ryjen has joined #ipfs
gmcquillan has joined #ipfs
reit has quit [Ping timeout: 246 seconds]
rgrinberg has quit [Quit: WeeChat 1.5]
rgrinberg has joined #ipfs
jaboja has joined #ipfs
rgrinberg has quit [Client Quit]
stoogenmeyer has quit [Remote host closed the connection]
rgrinberg has joined #ipfs
pfista has joined #ipfs
ryjen has quit [Ping timeout: 252 seconds]
stoogenmeyer has joined #ipfs
cketti has joined #ipfs
cketti has quit [Changing host]
cketti has joined #ipfs
Senji has quit [Disconnected by services]
Senj has joined #ipfs
Senj is now known as Senji
stoogenmeyer has quit [Ping timeout: 252 seconds]
<dignifiedquire>
noffle: really enjoying working with pull-streams :)
ligi has quit [Ping timeout: 258 seconds]
stoogenmeyer has joined #ipfs
f[x] has joined #ipfs
reit has joined #ipfs
ygrek_ has quit [Ping timeout: 244 seconds]
<richardlitt>
noffle: thanks!
zorglub27 has quit [Remote host closed the connection]
zorglub27 has joined #ipfs
Oatmeal has quit [Ping timeout: 260 seconds]
s_kunk has joined #ipfs
ligi has joined #ipfs
rgrinberg has quit [Quit: WeeChat 1.5]
ryjen has joined #ipfs
rgrinberg has joined #ipfs
yosafbridge has joined #ipfs
ryjen has quit [Ping timeout: 252 seconds]
f[x] has quit [Ping timeout: 240 seconds]
rgrinberg has quit [Ping timeout: 244 seconds]
rgrinberg has joined #ipfs
cryptix has quit [Ping timeout: 244 seconds]
arpu has quit [Ping timeout: 272 seconds]
rgrinberg has quit [Client Quit]
cryptix has joined #ipfs
rgrinberg has joined #ipfs
Encrypt has joined #ipfs
zorglub27 has quit [Ping timeout: 272 seconds]
arpu has joined #ipfs
draynium has quit [Max SendQ exceeded]
ryjen has joined #ipfs
stoogenmeyer has quit [Remote host closed the connection]
ryjen has quit [Ping timeout: 252 seconds]
palkeo has joined #ipfs
stoogenmeyer has joined #ipfs
jaboja has quit [Read error: Connection reset by peer]
rgrinberg has quit [Ping timeout: 276 seconds]
zorglub27 has joined #ipfs
rgrinberg has joined #ipfs
galois_dmz has quit [Read error: Connection reset by peer]
galois_dmz has joined #ipfs
draynium has joined #ipfs
uhhyeahbret has joined #ipfs
Encrypt has quit [Quit: Quitte]
G-Ray has joined #ipfs
ola has quit [Ping timeout: 264 seconds]
M-Dan has joined #ipfs
galois_d_ has joined #ipfs
galois___ has joined #ipfs
galois_dmz has quit [Ping timeout: 250 seconds]
achin has quit [Changing host]
achin has joined #ipfs
galois_d_ has quit [Ping timeout: 250 seconds]
erde74 has joined #ipfs
ligi has quit [Remote host closed the connection]
ryjen has joined #ipfs
cryptix has quit [Ping timeout: 244 seconds]
ryjen has quit [Ping timeout: 252 seconds]
computerfreak has joined #ipfs
computerfreak has quit [Client Quit]
matoro has quit [Remote host closed the connection]
matoro has joined #ipfs
rendar has quit [Ping timeout: 264 seconds]
vandemar has quit [Ping timeout: 272 seconds]
erde74 has quit [Ping timeout: 272 seconds]
corvinux has joined #ipfs
computerfreak has joined #ipfs
erde74 has joined #ipfs
ryjen has joined #ipfs
paragram has quit [Remote host closed the connection]
Arlene has joined #ipfs
ryjen has quit [Ping timeout: 252 seconds]
rendar has joined #ipfs
draynium has quit [Ping timeout: 250 seconds]
ligi has joined #ipfs
G-Ray has quit [Quit: Konversation terminated!]
<xioustic>
M-sokoow/Others (ultra late): I'll move my stuff to github soon; have had it on gitlab a long time but the DecentralizedWeb summit has inspired me to put more cool stuff out in the public after meeting the team.
<xioustic>
Moving a blockchain explorer to IPFS means also moving the elements of the blockchain that matter to the end user; if built from multiple other blockchain explorers that are public, they should resolve to same MerkleDAG head, so it also gives a sort of "audit" layer.
<xioustic>
Might demonstrate some benefits to those that might consider putting/distributing their blockchain via IPFS as well.
galois___ has quit [Remote host closed the connection]
galois_dmz has joined #ipfs
ryjen has joined #ipfs
<xioustic>
Also I am not a big fan of the privacy implications had by so many depending on querying a public blockchain index for their mobile / lite Bitcoin wallets. Surveillance easily reveals who is interested in what addresses. Correlation becomes a little harder if querying via IPFS.
cryptix has joined #ipfs
galois_d_ has joined #ipfs
Akaibu has quit [Quit: Connection closed for inactivity]
ryjen has quit [Ping timeout: 252 seconds]
galois_dmz has quit [Ping timeout: 272 seconds]
taaem has joined #ipfs
Encrypt has joined #ipfs
cryptix has quit [Ping timeout: 244 seconds]
matoro has quit [Ping timeout: 244 seconds]
matoro has joined #ipfs
cketti has quit [Quit: Leaving]
stoogenmeyer has quit [Remote host closed the connection]
rgrinberg has quit [Ping timeout: 240 seconds]
wallacoloo has joined #ipfs
ryjen has joined #ipfs
stoogenmeyer has joined #ipfs
eaterjolly1 has joined #ipfs
steefmin has quit [Ping timeout: 252 seconds]
<eaterjolly1>
Greetings!
* eaterjolly1
rolls on the dancefloor
steefmin has joined #ipfs
* eaterjolly1
waves
stoogenmeyer has quit [Remote host closed the connection]
<kevina>
And then we can decide what to do with the information. For example if you want to talk about it, file issues etc.
<whyrusleeping>
kevina: yeah, thats exactly what i was wanting to talk about. Basically getting a good idea of what is left to be done, what hard problems need to be worked out, and how the rest of the team can help out.
rgrinberg has joined #ipfs
<kevina>
So I think it would be a good idea for me to write up the issues first, and then decide what to do next.
* eaterjolly1
is totally using raspbian exclusively as their primary os
<M-hash>
how many $units time are you in southbay? i'd alloc a day to hacks on go-ipld iff someone is willing to volunteer bandwidth at keeping me aimed right
reit has quit [Ping timeout: 240 seconds]
ipfsrocks has joined #ipfs
<ipfsrocks>
Hi having trouble with js-ipfs and webpack
jedahan has joined #ipfs
<ipfsrocks>
First issue is cannot resolve module 'fs', fixed in webpack.config.externals
<ipfsrocks>
Then cannot resolve module 'idb-plus-blob-store' in node_modules/ipfs/lib/core/default-repo
<ipfsrocks>
and 'net' in node_modules/libp2p-tcp/lib
<ipfsrocks>
Not really looking for help just pointing out the experience is kind of painful
<dansup>
lgierth, is there an ipfs search engine?
<lgierth>
not that i'm aware of
<lgierth>
there's an issue in ipfs/notes about search though
<ianopolous>
whyrusleeping: if you have a daemon running, and you separately gc IPFS will they play nicely together, or are there data races with that usage?
M-infpetal has joined #ipfs
ryjen has quit [Ping timeout: 252 seconds]
computerfreak has quit [Remote host closed the connection]