Coingun, aka Jeff Smith I love that that's something that's normal to say in Dash

That you can call somebody by their web handle and then be like, oh, they're also known as Jeff Smith Which, would probably be funny because Jeff Smith could probably be a handle as well Sure, sure And often I'm trying out like — I'll go to a documentation site and it'll be like, for example, put in your name Jeffrey Smith, and I'm like, oh! That's awkward Because, that is my name

I'm the example I guess I don't even know What's going on? So yeah, it is funny Then there's people inside of Dash that all I know them as is their handle Like Udjin

I just Udjin, is that his name? I don't know Yeah

But he's a brilliant master Indeed he is And speaking of masterful skills, or what it is that people do in Dash please tell us, what Ok, so I asked you, what is your title? What is it that you do? You told me Network Operations You said, I do network operations with moocowmoo Speaking of another handle And, you can probably guess about me Jeff that I don't really know what that entails Much less the details of it

So, what are network operations in Dash? Absolutely You know, I think the first thing I'd like to start with is — because it's a pretty subtle thing that we do, but — we're involved in onboarding all the new developers setting up the development and testing environments and then staging environments So, when we hear about Dash growing and Dash adding new users and adding new employees that's a direct thing that's involved with network operations So we're setting them up with their email, giving them their access that they need to our different systems For example, snogcell recently needed a couple servers spun up, he needed access to testnet and main net, and so that's something that would fall on the network operations team

So it's sort of like that in-between section between developers and the business management team and then the network infrastructure that Dash actually handles So, we're getting those developers and getting those people the resources that they need or, handing them off to the developers Ok, so then you help new employees get access both to things that are the network itself, such as testnet, but then also things that are like specific to the Dash core team Like for example, the email servers that handle Dashorg email and like various Dash

org core team specific stuff? Yeah So you could think of it like — I mean I call it infrastructure — it's got lots of different names It's not overly physical anymore It's a lot of cloud-based VPS services Very similar to what you'd run a masternode remote end on

You know, we have 30 or 40 different VPS instances that vary in range from a couple of gigs to 30 gigs or so And those are the systems that support the public-facing Dash infrastructure So, when you go to our website and it responds When you hit our forum and it responds Different things like that

When you look up Dashorg and you get a response from our DNS infrastructure So it's all the sort of basic things that you need to be on the internet So you need a domain You need web services

Domain name services And all these different things We're keeping all of that stuff working behind the scenes Most of the time So that everybody has this great experience

But what I find can be a little bit unique about the situation is that it's a very publicly facing issue when anything goes wrong So, as soon as the site goes down everybody knows about that And everybody is concerned about that And everybody wants you to do something about that right away And so, I think that's the biggest thing that takes learning in network operations is dealing with that stress

That, this has to be done right now Drop everything that you're doing Get if fixed This is so important And not everybody can deal with that type of stress

So, how did you come to be doing network operations for Dash? How did that come about? And when? Yeah so I've been involved pretty early — I was about April, 2014 and so just missed, just after the fastime Had sort of, probably had seen some of that through the forums and stuff like that and that was kind of why I had started reading about, at that time it was Darkcoin I originally got started — to aside a little bit — in mining I was a big miner

I actually mined Bitcoin on GPUs and then got one of the first Bitcoin ASICs Some people haven't even seen these This is like the very first little ASIC chip that ever came out for Bitcoin I think I paid like one Bitcoin per stick And I think I have like 22 of them, or something So it's like 22 Bitcoins at that time

Ridiculous Wow $100 Bitcoin And so I mined some SHA on GPUs, and then I mined some SHA on ASICs and then I got into Litecoin mining What's up Litecoin

Love you still Haha! And then I just, it was just like ok, well what's going on really? That was sort of right at the bubble — like you had Litecoin went to $50, Bitcoin went to $1150 or something And it was just like, wow this is crazy And then, you know, the altccoins started mixing it up and I was just curious I was looking for the new thing to mine, or the next thing to mine

And X11, it's efficiency is just amazing So I went from running all these Litecoin miners with tons and tons of power to being able to switch over to X11 and using like literally a quarter of the power, or half of the power And I was like, wow That's kind of interesting Someone put the time to thinking about how to do this more efficiently

And then you know, I got more involved with Dash It was IRC at that time There wasn't really a Slack and stuff like that It was still, everybody did IRC And then I was like, oh, so I can mine X11

What about these masternodes? That's kind of like mining The reward is a mined coin But I don't have to put up with all the loud noises, and all the video cards, and all the wire grumblings Haha! I'm up in Canada I think I actually heated my house for one winter with miners

Literally It was like -10 or 15 outside and my house is warm because these miners in the basement are just like heating the whole place So it was really mining that brought me in And being an infrastructure guy already — you know, I ran data centers I did a lot of different stuff like that and it just was natural to go from big servers humming to big miners humming and it kind of gave me that geeky

Most miners will understand that, just that geeky feeling deep down inside You're like wow, this is cool These computers in front of me are doing a ton of work right now

Like actually being used I think a lot of computers — they sit and remain unused You know like, if you look at the life cycle of even your laptop or your desktop, like how often is it running at full capacity and doing something fully? I'd say like 10, 30% of the time that it's doing it And so, for us networking guys to see these computers going crazy And they're actually giving out results and it's all valid

That really gets me going It's kind of geeky but I can tell you have the feels right now

Yeah Absolutely It's just — you know, this whole trip, this whole, well the last three months since Miami has been crazy But yeah, I digressed a little bit there Mining brought me in

I started in Dash around April, 2014 I wasn't an official core team member until about September maybe October was my first actual team payment And that was really just a natural progression Since the start I'd always been in touch with moocow He'd been — like he always does — he's so willing to train people

He's so willing to just put his time into teaching And so he was teaching me for a while and then I was sort of asking him more questions and then I would see sort of a hole where maybe the core team hadn't spun up a specific service or something And I said, oh you know what? I'll just spin that up So you know, I had some services running under masternodeio just to sort of fill the gap

Similar to DashNinja or DashVoteTracker Community led services You know, paid for by the community, run on community equipment but give a very, very important or do a very important job for the network And so then it was just a natural transition where I started, or I stopped turning out my own services And I started turning up services for Dash

So I rebuilt the Electrum servers Put away my old Electrum servers Build some new ones for Dash And then it was just sort of trying to become involved where ever I can The network operations team really grew from — you know I was talking to moocow before the interview and I was like, how did that transition go? My understand of it, forgive me if I get any of this wrong you guys

I've kind of translated it through a few different things, but, But it was basically Evan Evan the one-man show He set everything up He did all the coding Everything

And then Evan got involved I think it was Flare that came on and Fernando And so some of those jobs were taken over by those guys And then eventually Flare and Fernando were busy and so that was passed on to moocow And then now, you know, moocow's gone through and passed it on to me

Or is starting to pass things on to me And, what it really shows is just that we're growing an expanding And the scope and the demands of this project are just getting bigger And so, we had to make sure that there was some redundancy And so moocow's built in sort of a Trezor-backed log-in system for the three core network operations guys

So myself, moocow, and Flare And so, we're geographically spread out So west coast, east coast of North America and then out in Germany And so that works pretty well for the timezones Flare can be online when I'm not

And moocow's online before I am And I'm online slightly after Well, I want to say slightly after him but I don't think the guy ever sleeps

He's often messaged me at 4 in the morning his time, which is like 7 in the morning me Or whatever, the other way around, it's just like, what are you doing? Go to bed man And I don't know The guy's insane In a good way

In a very, very enjoyable way It's fun to be a cook in his kitchen and he just has such a neat take on infrastructure A lot of people, when we had this price rise would have just started spending Buying crazy servers and all this stuff And let's just throw all the resources at it

And moocow's — he described it really neat, I'm going to quote him, and he says, it's like cooking, like it's easy to add, it's really hard to take away And so we use that same approach with our infrastructure, is that we like to add subtle, easy, small bits at first, see how they work, and then grow them or add to them when needed And what that allows us to do is to keep our budget low but still be prepared for things that we could come across Such as a DDoS or things like that You know, I'm glad you bring that up

I would be interested to hear of, what was the experience of the DDoS like for you? And if I'm not much mistaken, I think — did you mention that you had written the report? About the DDoS — like the wrap-up report? I don't want to say that I wrote the report I mean I definitely spearheaded getting it out One thing that happened recently was the cloud bleed bug from CloudFlare Oh, I remember hearing about that I would like to hear

That was a few weeks ago, right? And after that CloudFlare released a really, really comprehensive basically a report Saying, this is what happened This is what we did

This is how we have learned and this is where we're going from here Now, quickly to clarify Would any masternodes be using CloudFlare or would this just have effected like the Dashorg website? Yeah this is more like, CloudFlare's a service that sort of proxies traffic, so this would have more effected sites like BTC-e, exchanges So more of the infrastructure like core infrastructure

The masternode network is kind of weird because it is our infrastructure but we don't really run it All the community members run it, right? So, we'll loop back to this but that's why, when it was getting DDoS'd there's not a lot you can do It's not like it's 4,000 servers that moocow and I have shell on and we can just quickly deploy some sort of traffic re — that doesn't happen So for us what it was, was trying to help How can we give these people the tools they need? But just to jump back, so you know, CloudFlare put out this report and it's just world class

It shows why they are in the spot that they are And when moocow and I were talking about it and reading it you know, I had said to him, I would really like us to be this transparent I think we are this transparent in a lot of ways and I think it's really, really important that we handle this professionally And so I asked in the dev channel, hey what do you guys think about doing this sort of report? And there was no real negative response, which I've learned probably means it's a positive response But also no one wanted to say, oh that's a good idea, because then they're now doing the report

Oh I said, you know what, no problem Let me spearhead getting this started I know exactly what I want to kind of see and so I just built a Google Doc, and shared it with a few people, and big shout-out to Andy and all the boys that jumped in there Timothy was in there

I mean every core dev was basically in that document So, although I had started and laid out some of it, it was really very quickly taken over and or augmented by multiple different people on the team So, I really don't want to take credit for anything other than just sort of getting the ball rolling That was truly an experience that is unique to Dash Is that these people all over the world were able to come together very quickly and come to a resolution and get out some good content for the network

And I think that's important I think that's something that not only do we need to make sure that we continue to do, but it's something that will give confidence to our investors It'll give confidence to them to know that hey, if these things happen, and we don't know what to do, we can feel confident that the core team is actively researching this for us You know, Chaeplin has just been amazing Like the guy, from the time the DDoS hit to the time he had the rules, he basically learned the entire UFW stack and how to work it

That's insane Like some people take years to learn firewalls And this guy puts out a set of firewall rules like very comprehensively, in five or six hours And I mean, I wish I was that guy I wish I did it as fast as he did

I wish I were Chaeplin too Right? Sometimes? There's a lot of people I wish I was sometimes Maybe half

Yeah Like if we could clone moocow I'd take a clone Sure Well I want to wrap-up by asking you about your surroundings

I see these sort of fancy monitors around you Is that like some sweet decoration that you got for today's video which I appreciate, or what is that? Are you in your Dash office or what is it? Exactly I call this the network operations center in Canada And so, this is the dash-newsde/dashtv/ just showing the price of a masternode right now — what it's worth, what you're getting for it

Below it here is the listenmasternodeio where I'm always talking about how busy our blockchain is You know that screen very recently was empty And people talk about our transactions going up, yeah they are

I'm watching them every day and I see them all the time Below that is the Dash Poloniex chart Above here is Chaeplin's awesome, awesome system So this is how we actually noticed the DDoS Or I think this is how he noticed the DDoS So, you can just sort of see the last bit of it right there

That really big bump That was the actual triggering event where Oh you probably can't see it on the glare, it's pretty bad

Oh no, I saw it I saw it You see that right there? It's just like right there And so that was the bump where the connections from, you know, like a normal masternode would have maybe 25 or 50 connections and all of a sudden those masternodes were jumping up to like 260 or 270 So that is again a Chaeplin original

I asked him, hey man, I really need something for my TV And so this tells all different things about the network You know we're seeing masternodes enabled, how fast the blocks are coming You know Just lots of different stuff like that And then over here

I like to still keep an eye on the king Bitcoin Because, you know We all like to know about Bitcoin And then that's just Canada

Or sorry — I think it's Bitfinex and Kraken And then at the very top there I use that one on the main TV when we're trading I still do a bunch of trading And that one's average Dash price, average Bitcoin price across most exchanges in the world So, really at the end of the day it's just something that I can use to keep a visual eye on the network

Keep a visual cue on what's going on And if I need to react, I can react I will not rest until I have a room, just like that Well you know, you keep going with these DASH: Detailed videos and all the great content you're putting together, and it could very well be something that we create for you I don't think I've often talked to a lot of people — I don't think you can have too many screen

s It's like, you can't have too many There's just — it's not possible And maybe I have a little bit of a I don't know Maybe I like screens too much? But I'm going to think on that

On whether you've just stated a truism When you say that you can never have too many screens I'm going to think on that and I appreciate you giving me that food for thought as we finish our interview I want to say thanks for your time coingun, aka Jeff Smith Well thank you very much Amanda

And don't forget to hit me up on Twitter at @coingun Love to hear from you guys Love to talk to you guys And thanks a lot for the interview today