The Biggest Mistake I See Engineers Make(thezbook.com)
thezbook.com
The Biggest Mistake I See Engineers Make
https://www.thezbook.com/the-biggest-mistake-i-see-engineers-make-2/
73 comments
Up until about a year ago, IC meant independent contractor to me.
Individual contributor sounds like a human resources rebrand for lower pay or power.
Individual contributor sounds like a human resources rebrand for lower pay or power.
Principal engineer roles are pretty desirable. I know a number of managers of engineers who wish they had gone a PE route rather than a management one.
I know very few PEs who say "Oh, I wish I had a whole team to manage, worry about hiring/retention, reviews, administration, etc"
I know very few PEs who say "Oh, I wish I had a whole team to manage, worry about hiring/retention, reviews, administration, etc"
How about a label given to a track that runs parallel to manager?
Depending on the place, it can mean different things. I've seen it also mean "team member" or used for senior engineers whose roles (navigating across different teams on short/mid-term important/investigation/transformation projects not necessarily visible on the official R&D roadmap) makes it difficult to attach them to a particular team/specific role.
The people and places that handled well this level of fuzziness do so _thanks to_ a good amount of trust, care and shared vision.
The people and places that handled well this level of fuzziness do so _thanks to_ a good amount of trust, care and shared vision.
IC to me means a developer who has no interest in managing people.
I’ve understood IC to mean individual contributor for over a decade. I think the industry just over uses acronyms and as a result you end up with collisions.
> Individual contributor sounds like a human resources rebrand for lower pay or power.
I’ve been in companies using this term for the last decade and definitely do not think this is the case. If anything it’s a movement to empower people that don’t want to be on a manager track by offering them a precise term to describe their track.
It simply means people with no direct reports.
I’ve been in companies using this term for the last decade and definitely do not think this is the case. If anything it’s a movement to empower people that don’t want to be on a manager track by offering them a precise term to describe their track.
It simply means people with no direct reports.
It means someone who is not a people-manager. That is, someone who _contributes_ to the team/company by actually doing things, rather than by supporting/directing the work of others.
Trying to think of other words for this... programmer, software developer, software engineer. But those words are all role-specific. IC has the advantage of conveying that the person is not managing, but is generic with regards to role. Non-manager works, but that emphasizes the negative.
Hmm.....
Trying to think of other words for this... programmer, software developer, software engineer. But those words are all role-specific. IC has the advantage of conveying that the person is not managing, but is generic with regards to role. Non-manager works, but that emphasizes the negative.
Hmm.....
Calling someone a “software engineer” also doesn’t clearly communicate they are not managers.
At my last job my team were at one time referred to as "onshore resources" despite all being employees and in the same office.
An IC is a role without positional authority but the company will indoctrinate you with “lead by influence” internal training courses and tell you that you can effect change purely by your charm and will question why you can’t get that person or department to solve their bugs. It’s all part of the we-are-a-flat-hierarchy mantra and you know we are all equal (in skill, drive and initiative).
Also not a software engineer but I do believe that software engineers have a very good workflow. I've been trying to figure out what the equivalent of a pull request could be for non software engineers (like hardware development). Is anybody aware of people who have tried to do something like this?
It's the merge part that is an issue. PR works on text files and on the line level, which fits code perfectly, as most statements are one line. For prose, it's messier. In other media it's difficult because of the cohesion of purpose needed, or just that you can't merge easily. It's easier to cooperate on the person level, than on the product level.
you write an ECN (Engineering Change Notice). these stack up against a given part number (controlled by a drawing). then the drawing gets updated. this is where any conflicting ECN's get discovered.
Note: ECN's were how things worked when you had a draftsman. Most engineers do the CAD themselves nowdays.
Note: ECN's were how things worked when you had a draftsman. Most engineers do the CAD themselves nowdays.
I am not a software engineer so I am obviously not the target audience
Still, what is said here really applies to any type of engineering. I've encountered pretty much everything mentioned both for software engineering and electronics and mechanics. Just replace the software-specific lingo with their generic principles (e.g. PR = review by others).
Still, what is said here really applies to any type of engineering. I've encountered pretty much everything mentioned both for software engineering and electronics and mechanics. Just replace the software-specific lingo with their generic principles (e.g. PR = review by others).
Exactly. Remove (or define) the jargon and this could be a piece that would resonate with any sort of project manager.
Peer Review
I am not sure this behavior is limited to software. While this behavior occurs commonly enough to qualify identify from repetition I would also say it’s not the most repeated or worst behavior I commonly see from software developers or other professions.
I'm unsure what you're responding to here and I definitely don't know what "qualify identify from repetition" means, but I wasn't singling out software developers or saying that using jargon is the biggest crime on the planet, just suggesting how TFA could have been better.
I’ve been in this situation (worked too long on something without syncing with others). But I’ve also been on the opposite side. Some of my biggest accomplishments in my career, where I really added value, were when I went deep on my own and figured something out.
Think of software design as a space with dimensions. You’re trying to optimize for something over that space. Development is ideally a series of incremental steps toward the optimum. The daily standup is where you check in and make sure your last incremental step was in the right direction. Generic developer of level N can make those steps. But what if you are stuck in a local minimum? How are you and your teammates going to find what is over that next mountain unless someone goes out there and brings enough provisions to spend the night? There’s gold in them there hills.
Think of software design as a space with dimensions. You’re trying to optimize for something over that space. Development is ideally a series of incremental steps toward the optimum. The daily standup is where you check in and make sure your last incremental step was in the right direction. Generic developer of level N can make those steps. But what if you are stuck in a local minimum? How are you and your teammates going to find what is over that next mountain unless someone goes out there and brings enough provisions to spend the night? There’s gold in them there hills.
There’s a balance to be kept. It’s definitely not good when someone spends too much time on their own trying to get things just right. On the other hand a lot of modern agile trends seem to result in a lot of folks losing site of the big picture.
Sometimes a problem is hard and needs time to figure out. In a lot of cases adding too many people to the discussion can result in distractions and churn due to their individual priorities and limited understanding of the problem.
The best I’ve figured out here is to constantly ask for feedback from only the people who would be directly effected by the immediate task I’m working on. But that’s also deceptively hard to figure out sometimes.
Sometimes a problem is hard and needs time to figure out. In a lot of cases adding too many people to the discussion can result in distractions and churn due to their individual priorities and limited understanding of the problem.
The best I’ve figured out here is to constantly ask for feedback from only the people who would be directly effected by the immediate task I’m working on. But that’s also deceptively hard to figure out sometimes.
While I generally agree with the article I think a bit of nuance it could use is that sometimes not looping in other people, even if it causes problems now, can be the right move for your overall career growth. A key component of growth is being allowed to make your own mistakes. If you always let stronger engineers come in and handle the tough bits you might never obtain the sort of knowledge and experience that let you advance and frankly, your company doesn't want you learning those lessons on their dime if they can avoid it. Going off on your own can be one way to gain that experience even if it irks the people you work with.
Yes and no. I think an important concept is one of "buy-in".
If you cannot get your manager/boss/co-workers to buy into a method/strategy/path, you are setting yourself up for a harder path to success.
It is better to try to get buy-in earlier than the completion of project/code/documentation.
If you cannot get your manager/boss/co-workers to buy into a method/strategy/path, you are setting yourself up for a harder path to success.
It is better to try to get buy-in earlier than the completion of project/code/documentation.
As a manager you need to help set up a culture where showing unfinished work is ok. On my current team I will often make a quick prototype and ask our TL "Can you take a look to see if this is a completely off base approach? This code is not done yet but before I put more time in it I want to validate it's direction." My TL says that this behavior wastes his time and I should only show him fully finished work. He'll often say there's no tests or linting errors instead of looking at the approach. Same thing happens with design docs. If I'm even editing for spelling he'll refuse to look at it. "Ping me when you are finished editing".
It's a complete waste of my time to completely finalize something, have him take a look at it for 2 seconds, and then say it's the wrong direction.
And yes, we have tried to specify tickets more but he wants more general stories to allow the engineer to identify and approach. He just wants us all to identify his approach without him telling us.
It's a complete waste of my time to completely finalize something, have him take a look at it for 2 seconds, and then say it's the wrong direction.
And yes, we have tried to specify tickets more but he wants more general stories to allow the engineer to identify and approach. He just wants us all to identify his approach without him telling us.
That TL is crappy.
For my team, I even encourage them to publish PR before doing any test.
They can start writing tests, but please publish PR before.
For my team, I even encourage them to publish PR before doing any test.
They can start writing tests, but please publish PR before.
Interesting. I encourage people to publish early/often. However, depending on the problem, I would rather see some tests early on which would be defining the approach being developed. It's not necessarily a black/white issue for me, but there are cases where having some tests (or even just some written docs with the thinking outlined) is preferable.
I understand that there might be some cases that prefer a test.
However, when communicating a guideline like this, it is better to make it simple. Otherwise, then it would be equivalent to no guideline.
A guideline like this isn't meant to cover 100% of the cases anyway. If there are exceptions, I simply tell them to add some tests.
However, when communicating a guideline like this, it is better to make it simple. Otherwise, then it would be equivalent to no guideline.
A guideline like this isn't meant to cover 100% of the cases anyway. If there are exceptions, I simply tell them to add some tests.
Misaligned incentives. Engineers want to do cool work; laying the foundation is often the only way to distinguish themselves. Interrupting it by involving others at each step is often counterproductive (three women one child in 3 months etc.) Managers on the other hand need replaceable cogs doing the work at somewhat predictable pace.
No.
The biggest mistake engineers make, and they make it often for year after year, is not moving to another company when it is the right time to leave where they are.
To zeroth order, all engineers are overdue for a move.
The biggest mistake engineers make, and they make it often for year after year, is not moving to another company when it is the right time to leave where they are.
To zeroth order, all engineers are overdue for a move.
So we should all be continuously moving to another company? In order to achieve what? More money?
More money is always nice but I'd do it for a completely different reason: to send a message that their company is not the orderly garden they think it is.
Usually it's an almost-chaos that's being held together by everyone pretending that it's all fine. And by following a bunch of rituals nobody bothers to modify out of fear not to speak up against the majority.
Usually it's an almost-chaos that's being held together by everyone pretending that it's all fine. And by following a bunch of rituals nobody bothers to modify out of fear not to speak up against the majority.
This.
More money, different "stuff" (challenges, people, perspectives, tech, business domain, level of contribution, you name it). The human brain needs novelty.
And how do you know when is the right time? No room for growth? Boring tasks? Bad management?
When in doubt, I tend to favor change, but it's just gut feeling. Is there a more objective metric or it's just experience?
When in doubt, I tend to favor change, but it's just gut feeling. Is there a more objective metric or it's just experience?
I think the latter, but any of those options you listed are valid. The company has zero loyalty to you, get out if there's anything better and you should be looking for anything better at least annually.
> They train in school environments where they do classroom projects on their own, or work on long-term intern projects in a silo. They are used to having to figure it all out up front, submit it for review, and then get some sort of result, like a grade or return offer.
This is something I struggle with everyday. PhD students usually come from finishing their master and totally have this mindset. They feel like doing things only by themselves will be more valuable than if they seek collaboration. But we deal with very hard problems and previous experience is one of our best assets, collaboration with other team members is not only very well valued, but essential to get our work done.
A very importnat point, in my opinion, is that the students should not have to figure out all this by themselves. It is our job, as supervisors, to help them to change this mindset. Easier said than done...
This is something I struggle with everyday. PhD students usually come from finishing their master and totally have this mindset. They feel like doing things only by themselves will be more valuable than if they seek collaboration. But we deal with very hard problems and previous experience is one of our best assets, collaboration with other team members is not only very well valued, but essential to get our work done.
A very importnat point, in my opinion, is that the students should not have to figure out all this by themselves. It is our job, as supervisors, to help them to change this mindset. Easier said than done...
Some of my best work ever was produced exactly when I went deep and explored the problem space in exhaustive detail and produced an ideal solution after a week -- or five.
You can't plan and iterate on a plan that's forming as you go along -- it's a creative process and that's mostly chaotic by nature. And that's a good thing when doing exploratory work.
I get it, companies want assembly workers but a good chunk of software engineering doesn't fit that mold.
The whole article smells of control mania and micromanagement to me.
--
I agree with some points. Devs are prone to using overly complex solutions and it does pay off huge dividends to bounce ideas with somebody 2-3 times a week just to make sure you're not going down a rabbit hole that won't help the problem you're looking to solve. Sure.
What the author fails to account for is that your average manager and dev team are usually not at all helpful. They want you to solve a big problem but still want it done quickly even if they do absolutely nothing to help you clear up the requirements or familiarize you with previous work. And then get grumpy because predictably you can't do the whole thing quickly.
Well, AT ONE POINT SOMEBODY has to invest the time and effort to untangle the big spaghetti and put it in orderly boxes. Either remove roadblocks for me or get out of the way and let me fight this herd of ducks alone. Grumbling about how not everything fits into your nice Scrum charts is not helping anything.
--
I sympathize with the overall sentiment that we should do our best to iterate and not have work done in one giant step. But that's not possible for some tasks and this has to be respected, not mercilessly micromanaged.
You can't plan and iterate on a plan that's forming as you go along -- it's a creative process and that's mostly chaotic by nature. And that's a good thing when doing exploratory work.
I get it, companies want assembly workers but a good chunk of software engineering doesn't fit that mold.
The whole article smells of control mania and micromanagement to me.
--
I agree with some points. Devs are prone to using overly complex solutions and it does pay off huge dividends to bounce ideas with somebody 2-3 times a week just to make sure you're not going down a rabbit hole that won't help the problem you're looking to solve. Sure.
What the author fails to account for is that your average manager and dev team are usually not at all helpful. They want you to solve a big problem but still want it done quickly even if they do absolutely nothing to help you clear up the requirements or familiarize you with previous work. And then get grumpy because predictably you can't do the whole thing quickly.
Well, AT ONE POINT SOMEBODY has to invest the time and effort to untangle the big spaghetti and put it in orderly boxes. Either remove roadblocks for me or get out of the way and let me fight this herd of ducks alone. Grumbling about how not everything fits into your nice Scrum charts is not helping anything.
--
I sympathize with the overall sentiment that we should do our best to iterate and not have work done in one giant step. But that's not possible for some tasks and this has to be respected, not mercilessly micromanaged.
There's this general advice of "keeping people in the loop", and I like the advice proposed at the bottom of the article, but I do think there's potential for more guidance on this topic, as teams work differently depending on the overall workstyle or the specific circumstances of a project.
If your team is all a bit allergic to endless design doc discussion, dropping one of those in Slack might not work too great. But maybe pair programming with one or two others on the feature to help get feedback could!
Others do like to plan things out, so having the running Google Doc, or "one-page design docs" with recurring check-ins with a core group of people can do wonders.
There's the Amazon-style "write the marketing pitch", or internal-facing API documentation. And for some people iterative can mean shipping your API in layers, whereas for others it means shipping features bit-by-bit.
There are a lot of options, and I would love to see a huge compendium about it!
If your team is all a bit allergic to endless design doc discussion, dropping one of those in Slack might not work too great. But maybe pair programming with one or two others on the feature to help get feedback could!
Others do like to plan things out, so having the running Google Doc, or "one-page design docs" with recurring check-ins with a core group of people can do wonders.
There's the Amazon-style "write the marketing pitch", or internal-facing API documentation. And for some people iterative can mean shipping your API in layers, whereas for others it means shipping features bit-by-bit.
There are a lot of options, and I would love to see a huge compendium about it!
In a perfect world, this advice is absolutely true (and I've been guilty of it more than once). In reality, here's my experience:
- poor specifications from the start, with moving targets in the middle
- nobody available or willing to give definitive answers
- management stuck in endless meeting loops rather than having time to look at what engineers are actually doing
- engineering team (often severely) understaffed and dealing with multiple projects each - not time, patience or mental capacity to dive into what everyone else is doing
-> result: crazy amounts of wasted time for everyone
This, as so often, is a result of lack of time, patience and _planning_. It feels like "Agile" has become a convenient excuse to just start and figure out what it is we're building as we go along...
This, as so often, is a result of lack of time, patience and _planning_. It feels like "Agile" has become a convenient excuse to just start and figure out what it is we're building as we go along...
Add to this list, the exploratory ideas/projects that sometimes may be too small/early/fragile to share _because_ they're not well formed enough AND the team/place/company culture doesn't want/know how to handle it (recognizing the fragility of early ideas and not tainting them when it's not well-formed enough, leaving time/space for research/experimentation, tolerating failures).
There was a discussion about this a few days ago for those interested (588 points, 385 comments):
https://news.ycombinator.com/item?id=30074949
https://news.ycombinator.com/item?id=30074949
It is management failure, not engineering failure!
Absolutely agree. For a manager to say "Hey work on this feature and get back to me when you're ready" simply isn't managing.
Any project no matter how big or small needs to start with an end in mind. Even if it's an open-ended task or you are building a prototype where everything is an unknown. It's not difficult to draw lines in the sand before you even start.
Any project no matter how big or small needs to start with an end in mind. Even if it's an open-ended task or you are building a prototype where everything is an unknown. It's not difficult to draw lines in the sand before you even start.
at highlevel, you must know what you're supposed to deliver, which can be extremely difficult when not everyone does (incl yourself) so people start to second guess things to 'get things moving' which can be a huge risk and potentially completely wrong.
Understand the actual problem , write it down and repeat back to get confirmation.
write down the (non)functional requirements from the stakeholders, the exact scope of work before doing anything, again repeat back to get confirmation,
In the murky world of greyness where people do not really know information or the full set of data, agree (again before starting work) on little subtasks/ plans to get the information (PoC)
Write down the Risks/ Assumptions/ Issues/ Dependences of your actions and again get them signed off
all this takes time and can be extremely boring relative to getting stuff done, so a lot of people just do stuff they think is right
Understand the actual problem , write it down and repeat back to get confirmation.
write down the (non)functional requirements from the stakeholders, the exact scope of work before doing anything, again repeat back to get confirmation,
In the murky world of greyness where people do not really know information or the full set of data, agree (again before starting work) on little subtasks/ plans to get the information (PoC)
Write down the Risks/ Assumptions/ Issues/ Dependences of your actions and again get them signed off
all this takes time and can be extremely boring relative to getting stuff done, so a lot of people just do stuff they think is right
I think that managers should involve themselves in that. I've worked with people who think that giving you a task and receiving an implementation or status report is their unique job. But when you want to flesh out the task and request for more information, they see you as bothersome.
My experience with this issue has correlated highly with poorly written specs and/or stories (or worse, none at all). This in turn usually means that someone in the team is being lazy about the work to be undertaken.
I get it - writing good specs and stories is hard work. But as a way of organizing and "guard-railing" work, they are priceless. If you can't explain in words the work that needs to be done and share and socialize that, you're not ready to start building the product.
I can count on one hand, literally, the number of engineers I've worked with who could magically craft an amazing product out of thin air and even then, there were parts of those codebases that were horrifyingly difficult to modify down the road.
I get it - writing good specs and stories is hard work. But as a way of organizing and "guard-railing" work, they are priceless. If you can't explain in words the work that needs to be done and share and socialize that, you're not ready to start building the product.
I can count on one hand, literally, the number of engineers I've worked with who could magically craft an amazing product out of thin air and even then, there were parts of those codebases that were horrifyingly difficult to modify down the road.
It really depends, you can turn this into an advantage instead of a mistake. I think the element of it that is a mistake is the bit where its happening in a way end customers don't see, or the reason its done quickly is its for an MVP/initial launch and to speed that up as much as possible.
There is a certain threshold in a team where incremental communication yields increasingly decreasing returns very quickly, and slowly starts to become a cost. If you can find the sweet spot, and leverage your engineering knowledge to peek in, this 'mistake' can be an advantage.
There is a certain threshold in a team where incremental communication yields increasingly decreasing returns very quickly, and slowly starts to become a cost. If you can find the sweet spot, and leverage your engineering knowledge to peek in, this 'mistake' can be an advantage.
Speccing something that is under-specced before coding and splitting big fuzzy task into a list of less vague tasks is a critical skill.
There's some similarity to big tech interviews: you often get an intentionally fuzzy task and your first job is to ask clarifying questions and tell your assumptions out loud. If you go straight to coding it's a big red flag.
In this vein, we can say that kind of interview prepares candidates to the real job where others are busy and don't have infinite time to write perfect specs and just hand them out to you to implement.
There's some similarity to big tech interviews: you often get an intentionally fuzzy task and your first job is to ask clarifying questions and tell your assumptions out loud. If you go straight to coding it's a big red flag.
In this vein, we can say that kind of interview prepares candidates to the real job where others are busy and don't have infinite time to write perfect specs and just hand them out to you to implement.
“Thrives in ambiguity” is a requirement for high level promotions at Google and other big techs. It’s a critical ability.
Sometimes discussion with other people takes more time than actually doing something. Trying to loop in other people make junior developers paralyzed of doing anything outside theirs tickets. You will create a generation of developers that are useless if requirements are not fully defined and tickets are not broken down into tiny increments by senior dev. I am tired of handholding people.
I'd rather handhold juniors in a way that I know what they're going to fail on. I won't pre-empt them in all cases, because failing is such a good way of learning. That doesn't mean I just let them fuck around, it is the job of the senior to steer the junior.. if you don't like that part, say so up front to your team. I doubt that works in the majority of jobs.
Once you create this safe environment where Senior is there for difficult moments and everything is under your plan "that I know what they're going to fail on." you will create greenhouse plants that cannot survive on their own. In addition, you will get distracted from higher value work.
In my current role, I help 10-15 people weekly across multiple teams and domains. After a period of time, I discovered that it was a mistake. I can see that their's personal grown is limited, they would more likely lean on domain expert instead of becoming expert themselves. Now I am tired and distracted, partially because of lack of seniors.
In my current role, I help 10-15 people weekly across multiple teams and domains. After a period of time, I discovered that it was a mistake. I can see that their's personal grown is limited, they would more likely lean on domain expert instead of becoming expert themselves. Now I am tired and distracted, partially because of lack of seniors.
The trick is to guide them, not do the actual work. Even if you know how to do it, the job is their responsibility, not yours and you can't/shouldn't do two people's work.
I like these kinds of reflections, but I always miss the context.
These abstract counsels don't translate well to ability to identify when we actually need to apply them. Providing context, detailing one or more situations when the writer learned these things may contribute to transfer a bit of tacit knowledge.
These abstract counsels don't translate well to ability to identify when we actually need to apply them. Providing context, detailing one or more situations when the writer learned these things may contribute to transfer a bit of tacit knowledge.
The majority of software advice online is lacking the information about the contexts where it works.
The biggest mistake I see managers make is not letting their engineers work on anything for longer than four hours without demanding a status check abd injecting FUD into the process. Utterly demoralizing.
Yep. That's one of my top reasons to change companies, and this has been true for many other programmer acquaintances as well.
This is very subjective advice. You could also endup with very patchy inorganically grown software when you dont do any upfront design. It depends on the scale of your project.
If you are adding a minor feature to the product vs if you are creating the datamodel of a new product.
I would only show the datamodel once I have run enough experiments to make sure that it can support the next couple of years of application software
I think the author slightly misses the point in the "why do they do it" section. People do it because being a software engineer, at least in US tech companies, is one big pissing contest. People, even if they're being nice, are just constantly trying to demonstrate technical prowess -- technical superiority over others. That's how you get respect and that's how you get promotion.
Contra to this, putting together design docs/PRDs/RFCs at an early stage is useless busywork, and engineers should go grab a coffee together and have an open-ended informal discussion about their work before they do anything else. Attempting to stop your team from working in isolation by throwing paperwork at them is less effective than just getting them to talk to each other.
Like it or not, that is how software gets built.
In the construction industry, there are construction managers and individual skilled workers but behind it are the architects. There’s hardly a mention of the solutions architect role in tech work discussions. They are neither manager nor IC in the definition of what they do.
The biggest mistake I see engineers make is designing a to z without getting a to m rock solid. Or planning how they’ll structure their future companies under an umbrella without launching one yet. Worrying a lot about much later stages without even getting started.
but on the opposite side of the spectrum, worrying way too little about accommodating likely future requirements down the road in such a way that the giant hairy mess they create is basically impossible to change
i don’t have the link handy, but this was discussed here a couple days ago
Couple of ways to dig it up.
First: Click the little greyed-out hyperlink next to the title of the submission that goes (thezbook.com): https://news.ycombinator.com/from?site=thezbook.com
Second: Query hn.algolia: https://hn.algolia.com/?q=thezbook.com/the-biggest-mistake-i...
First: Click the little greyed-out hyperlink next to the title of the submission that goes (thezbook.com): https://news.ycombinator.com/from?site=thezbook.com
Second: Query hn.algolia: https://hn.algolia.com/?q=thezbook.com/the-biggest-mistake-i...
TL;DR YAGNI + do an actual "build vs buy (including FOSS)" in good spirit on absolutely everything.
The biggest mistake I see other engineers making is opting to build vs buy when it's commodity stuff that we could easily and cheaply buy (or even use FOSS for), e.g. log shipping software, monitoring agents, etc. I see folks building "frameworks" for agents they'd like to run, and dreaming up entire ecosystems, of course with complex message busses and cert strategies...
Please don't re-invent Fluentd / Logstash / Prometheus etc unless you have a very compelling reason to do so. Also, your UI will suck, and if you make support staff use it, they'll hate you and you'll lose trust. There are so many great free dashboard tools out there, just pick one and learn it / use it. For stuff like reporting, there are a dozen ways to do that with stuff like Jupyter notebooks running on schedulers (and please please please don't try to write your own enterprise scheduler, again there are many out there that have been hardened over years of battle).
Don't run your own mail server. Just do not. If you've never dealt with IP + domain + ASN reputation and deliverability issues before, please just trust folks when they tell you that you don't want problems like that. Just use SES / Mailgun / SendGrid / whatever.
Don't re-invent JIRA. JIRA can do what you want if you take the time to learn it, and maybe add a few plugins or integrations.
Don't re-invent Jenkins. Jenkins can do almost anything. That doesn't mean it's the right tool for the job, but in many cases it's probably good enough to get you by, and easily adds visibility + access control + logging + who + what + when + kinda why + where and SCM integration to any ad-hoc task-execution or [see above] task scheduling needs. Jenkins is probably one of the most heavily battle-tested pieces of software in the FOSS enterprise software world, along with Apache and MySQL. I run Jenkins at home.
Don't use Java when you could do it with Bash, or even systemd / built-in OS functionality. Learn how linux works and what facilities are available on your given OS. You will likely find that many common problems have already been well-solved in depth.
If you can just pay AWS to run the service, it's probably worth it. Their stuff is also quite well battle-tested (at least non-early-access products), and stuff like RDS, CloudWatch, SQS, etc work pretty darn well these days. If you're already in AWS, don't just run everything yourself and treat it like a virtual datacenter -- to do so is to miss the whole point of "the cloud". You'll save OpEx in the end until you're operating at huge huge scale, and even then, when your finance team negotiates with your AWS TAM, they'll work out a decent-enough deal.
Edit: and please please please do not try to write your own etcd / zookeeper / Consul / Vault / Cassandra / Kafka. There's a good reason almost everyone uses this stuff: they works well, the ways they fail are well-understood, and they get updated regularly. You won't do a better job. Even if you work at a 10k person company and can dedicate a team to building it, you won't do better. Your implementation will be buggy and suck for years. Just buy it (for free). When I interview folks with stuff like this on their resume that they've built, I usually see that as poor judgement (unless they actually worked on one that ended up actually getting used outside of where it was invented).
Don't even try to touch building your own SSO. Buy Okta, Ping Identity, or Google SSO (Google Apps).
I'm not saying don't invent anything ever, just that I see so much damn waste when it comes to over-eager engineers wanting to build stuff that already exists as their own career builder vs solving the actual business problems in the most efficient way possible, which I've found to more likely than not be just figuring out the process / workflows and gluing a few pieces of existing software together. Not every problem needs to be solved with 18 dozen microservices and GRPC.
The biggest mistake I see other engineers making is opting to build vs buy when it's commodity stuff that we could easily and cheaply buy (or even use FOSS for), e.g. log shipping software, monitoring agents, etc. I see folks building "frameworks" for agents they'd like to run, and dreaming up entire ecosystems, of course with complex message busses and cert strategies...
Please don't re-invent Fluentd / Logstash / Prometheus etc unless you have a very compelling reason to do so. Also, your UI will suck, and if you make support staff use it, they'll hate you and you'll lose trust. There are so many great free dashboard tools out there, just pick one and learn it / use it. For stuff like reporting, there are a dozen ways to do that with stuff like Jupyter notebooks running on schedulers (and please please please don't try to write your own enterprise scheduler, again there are many out there that have been hardened over years of battle).
Don't run your own mail server. Just do not. If you've never dealt with IP + domain + ASN reputation and deliverability issues before, please just trust folks when they tell you that you don't want problems like that. Just use SES / Mailgun / SendGrid / whatever.
Don't re-invent JIRA. JIRA can do what you want if you take the time to learn it, and maybe add a few plugins or integrations.
Don't re-invent Jenkins. Jenkins can do almost anything. That doesn't mean it's the right tool for the job, but in many cases it's probably good enough to get you by, and easily adds visibility + access control + logging + who + what + when + kinda why + where and SCM integration to any ad-hoc task-execution or [see above] task scheduling needs. Jenkins is probably one of the most heavily battle-tested pieces of software in the FOSS enterprise software world, along with Apache and MySQL. I run Jenkins at home.
Don't use Java when you could do it with Bash, or even systemd / built-in OS functionality. Learn how linux works and what facilities are available on your given OS. You will likely find that many common problems have already been well-solved in depth.
If you can just pay AWS to run the service, it's probably worth it. Their stuff is also quite well battle-tested (at least non-early-access products), and stuff like RDS, CloudWatch, SQS, etc work pretty darn well these days. If you're already in AWS, don't just run everything yourself and treat it like a virtual datacenter -- to do so is to miss the whole point of "the cloud". You'll save OpEx in the end until you're operating at huge huge scale, and even then, when your finance team negotiates with your AWS TAM, they'll work out a decent-enough deal.
Edit: and please please please do not try to write your own etcd / zookeeper / Consul / Vault / Cassandra / Kafka. There's a good reason almost everyone uses this stuff: they works well, the ways they fail are well-understood, and they get updated regularly. You won't do a better job. Even if you work at a 10k person company and can dedicate a team to building it, you won't do better. Your implementation will be buggy and suck for years. Just buy it (for free). When I interview folks with stuff like this on their resume that they've built, I usually see that as poor judgement (unless they actually worked on one that ended up actually getting used outside of where it was invented).
Don't even try to touch building your own SSO. Buy Okta, Ping Identity, or Google SSO (Google Apps).
I'm not saying don't invent anything ever, just that I see so much damn waste when it comes to over-eager engineers wanting to build stuff that already exists as their own career builder vs solving the actual business problems in the most efficient way possible, which I've found to more likely than not be just figuring out the process / workflows and gluing a few pieces of existing software together. Not every problem needs to be solved with 18 dozen microservices and GRPC.
Programming is a one-person task. Looping people in gives the rest of
us something to schedule meetings around. So it really depends on what
you want, getting the job done, or creating more jobs.
Actually writing fresh new code is a one person task if nobody ever sees that code again. If someone has to read that code, it's a team activity. If you have to read someone's code, it's a team activity. Determining what to write, what _not_ to write, how to write it and why, are all team activities, often shared with non programmers. Programming is a very social occupation.
Typing is a one-person task, but the point of this article is that programming isn’t. The end product is improved by involving others.
I would _love_ to work in an organization where it was normal and encouraged to spend an hour with someone talking about what we want to do and how. no one wants to bother anymore.
Having said that, I would make the following points to writers who wish to engage outside of the narrow circle of their profession:
* It's nearly 250 words into this piece before we even get a hint that we are talking about software engineering here, and even then it's only because the writer mentions a PR. I know enough to know what a PR is, but a general audience would not. It's not until some 620 words into the article that software is actually mentioned and the general reader can say without a doubt that software engineering is what we are talking about here.
* Along with PR, IC is something that is never defined and this one was new to me (and a little tricky to search, but I now understand that it is an Individual Contributor). The PRD was easier to track down, but again not obvious, even from the context.
Again, I get it - I'm not the audience and this is a bit of industry in-talk. But I think it's something that worth thinking about - you don't have to dumb down your ideas for them to be understood by a much larger audience than your immediate colleagues.