|
If it's a t-class you ran out of CPU credit
|
#
¿
Aug 29, 2017 17:04
|
|
|
|
| # ¿ Apr 30, 2024 14:41 |
|
|
If mainland china deploy- You'll need to get an ICP license for yourself and if you're hosting clients/reselling one for each of them too.
|
|
#
¿
Oct 31, 2017 22:51
|
|
|
If you really want it in lambda and not sitting on your monitoring you could just use the cron schedule rule to fire it off
|
|
#
¿
Feb 23, 2018 09:35
|
|
|
Devops is just sysadmins that got tricked into release engineering but accidentally the whole infrastructure. It’s burn out zone staff reduction. The coming bubble pop and rush back to the warm bosom of CapEx and colos is going to be thunderous. I’m just saying stack paper.
|
|
#
¿
Apr 25, 2018 11:50
|
|
|
StabbinHobo posted:this seems beyond wishful thinking We’re a good big ‘breach’ (read: wide open bucket) away from c-suites getting nervous. With GDPR and the current political clime I think it’s not impossible but agree unlikely. Mostly worried about the Preso mucking about with aws. Kvetching. Completely agree on your other point. It’s already happened once, how many operator gigs are kicking around these days? That’s the rank and file sysadmins that are going to be hurting.
|
|
#
¿
May 2, 2018 11:47
|
|
|
They still do polygraphs? Aren’t they demonstrably bullshit? Like not admissible in a court of law levels of bs?
|
|
#
¿
May 3, 2018 22:17
|
|
|
Orkiec posted:I work in RDS. I wouldn't say it's chill per se, but I seldom work crazy hours. I'm pretty happy here. Is the aurora postgresql mode still built on the maria fork underneath the hood or are they just reusing the aurora name? Ah, yea, makes sense I guess.
|
|
#
¿
May 6, 2018 05:11
|
|
|
You can stream the file from S3 and serve it as if it were local. I don’t recall if there’s an easy way to do an IMS on that in the SDK but it wouldn’t be tough to do yourself. To act as a cache, I mean. Don’t forget to add an S3 endpoint to your VPC or you’ll be making unneeded trips out.
|
|
#
¿
May 9, 2018 21:42
|
|
|
I don’t mind cf I just wish there was an editor that did linting more than just ‘is valid JSON’.
|
|
#
¿
May 30, 2018 23:43
|
|
|
GCP has the friendliest pricing model of the big three imo. AWS’ is Byzantine and will gently caress you if you’re not mindful about it.
|
|
#
¿
Jul 11, 2018 12:00
|
|
|
AWS batch- as far as I can tell a queue's attached managed compute environment being disabled doesn't prevent the service from launching a machine to sit and do nothing if something enters the queue. Am I missing a config somewhere or is that just how it goes?
|
|
#
¿
Aug 4, 2018 00:22
|
|
|
Is anybody friendly with the Batch team?  I’d use it way more at work if you could give a job fractions of CPU, even if it were just one option at x0.5. As is it’s ok but we’re not throwing more and varied workloads at it because of that. Our needs are memory bound not cpu.
|
|
#
¿
Sep 13, 2018 21:06
|
|
|
Agrikk posted:I hear ya. I hear of lots of customers running into memory constraints and having to upgrade to a larger instance/tier/etc because they need more memory and the cpu stats mostly idle. It's not even that, it's that a job won't be dispatched to an instance regardless of actual cpu utilization. There's plenty of RAM and compute but it's looking at cores only. GCP's ultimate flexibility flies in the face of your point though. Yes I understand google lit money on fire until their clusters became self-aware and their offering is unique in this regard, but it exists, so... I stick around because of familiarity too but AWS has got to reign in the bs like wacky fee schedules especially with regards to bandwidth, echo above, pitching aws sure hasn't gotten easier.
|
|
#
¿
Sep 15, 2018 03:09
|
|
|
The new timeout is great, we’d been kicking to lambda from other lambda for some operations and now don’t have to be as careful. For the sql crunching guy- if you’ve already process for it I’d probably just use Batch and RDS. It’s the easiest service to deal with if you don’t care about the mix of instance types or the occasional run lag. Not the best, step functions or Athena, if it’s a fit for the data are smarter, but would probably take longer to implement.
|
|
#
¿
Nov 2, 2018 13:28
|
|
|
Does LB WAF consider X-Forwarded-For or true-client-ip for its rate limiting or is it just remote_addr and a counter threshold?
|
|
#
¿
Feb 20, 2019 21:45
|
|
|
Not java, but go’s and boto3. I don’t even think about the delay with those libs. That is, it’s as close to instant as network allows.
|
|
#
¿
Apr 19, 2019 14:36
|
|
|
Is there facility in sagemaker for deploying pre-trained Torch models? I know there’s a legacy mode for python endpoints, anything similar for lua?
|
|
#
¿
Apr 24, 2019 20:55
|
|
|
PierreTheMime posted:Is this a sane way to do this? It seems fine, but I wanted to bounce it off people to make sure I'm not doing something incredibly dumb. There’s a lot if ways to do this but I think Batch is an alluring solution for doing it without much work. The caveat is that sometimes Batch is slow to start a job, especially if it has to start a new instance. Not a big deal just something to keep in mind. What I usually do is just have a lambda watch consume the SNS from job state changes to give impatient people a dashboard or rest call. If you need it as durable but more hands-on/faster, I’d do it as step function instead. More glue to write but good service to learn anyway.
|
|
#
¿
Jul 14, 2019 12:39
|
|
|
No that’s fine. Unless it’s something that gets big/disparate enough purpose to warrant multiple bins, whether it’s in lambda or not is the first thing I check when arg parsing. E:pardon any misuse of terms of art, I’m coming from sh/go, not java.
|
|
#
¿
Jul 14, 2019 13:21
|
|
|
The boto3 based aws cli has some envars you can tweak to increase the worker pool. We ended up rolling our own client to maximize speed. If your needs are somewhere in the middle ‘s5cmd’ is much faster than I could tweak awscli into being. Just mind the differences in its verbs.
|
|
#
¿
Jul 16, 2019 19:10
|
|
|
If it's got to start a new instance to service the job, it can sometimes take that long. Be mindful of the memory requirements on the task, remember there's overhead, and add every drat instance that the job is capable of running on to the selection list. That's helped keep our stuff moving quickly.
|
|
#
¿
Aug 13, 2019 01:06
|
|
|
Speaking of go it's coming up on two years since aws-sdk-go-v2 has been out but not really, from the git it feels like it's a OMA. Is that coming anytime soon?Thermopyle posted:I don't know AWS well and I've come in to admin a project that is currently hosted across multiple EC2 instances and I have questions. Yea lambda, SQS. Redis for a queue?? You can do that or use a private dns zone.
|
|
#
¿
Aug 15, 2019 01:09
|
|
|
It’s ‘exec’ style arg passing. Annoying but yea
|
|
#
¿
Aug 19, 2019 17:37
|
|
|
The first rule of AWS is Amazon hates you The second rule is never forget Rule Number One The cloudwatch logs interface alone is proof enough that Bezos hates you and wants you to suffer.
|
|
#
¿
Aug 24, 2019 22:45
|
|
|
If it makes you feel any better, it's also sometimes fileb:// !
|
|
#
¿
Aug 28, 2019 01:38
|
|
|
Cloudwatch cron fired SSM Run command documents don’t seem to be honoring the log group and logging enable defined in the document. To get around it, we’re using the cron to then run the ssm command with the cloud watch output config flag but that seems really dumb. Is this a limitation of that service? Am I holding it wrong?
|
|
#
¿
Dec 17, 2019 17:41
|
|
|
S3 Batch Operations can have a lambda as an invoke iirc, that'd let you do it in one go as quick as the services let you, you can feed it CSV or s3 manifest. Not sure if the porcelain is as nice as I remember but check it out.
|
|
#
¿
Jun 7, 2021 14:26
|
|
|
Granite Octopus posted:God drat this looks perfect, thank you np, interested to hear how it shakes out for you.
|
|
#
¿
Jun 7, 2021 15:22
|
|
|
It’s definitely never been simpler to manage EC2, SSM is so good I regularly advocate for its use on-prem BUT gently caress doing it unless you have to. Fight for not doing.
|
|
#
¿
Jul 20, 2021 11:59
|
|
|
I know I'd be fine with minimal logging and tight envs since it makes bad dev and bad actor behaviors simply not possible. Getting that set up is a lot of front-loaded effort and slows dev velocity so if they really grok what you're saying they may be trying to avoid that without saying so. If the concern is repeated, from high up, I'd expect a vendor has been whispering in ears, however, good luck. 
|
|
#
¿
Jul 21, 2021 20:10
|
|
|
(so they can sunset development on the one that scales to 0)
|
|
#
¿
Jun 1, 2022 09:00
|
|
|
Cloudshell sib, if your dash creds do it, you can do it. CLI’s installed, you also get a small per-region persistent store.
|
|
#
¿
Jun 30, 2022 07:41
|
|
|
I’d shift that 80% up closer to 90 but otherwise concur. The amount of very bad shell invoking the aws cli passing for IaC I’ve seen is harrowing, though that might be a local quirk from so minicomputing grognards in the region.
|
|
#
¿
Aug 22, 2022 06:24
|
|
|
 We switched to grav as soon as possible, been cheaper and with grav2 it’s faster too. For our loads anyway, it’s good op. Drop-in if you’re running go or python, honest.
|
|
#
¿
Dec 21, 2022 11:45
|
|
|
Docjowles posted:Oh yeah this reminds me that you will start getting actual death threats from unhinged lunatics to your abuse@ address if they ever receive something they perceive as spam, lol A lot of us remember Docjowles posted:when everyone on the internet knew each other personally cause there were like 100 users and they were all at universities and government labs It's been a harrowing few decades
|
|
#
¿
May 18, 2023 20:44
|
|
|
They both go off like firecrackers.
|
|
#
¿
Jun 15, 2023 21:19
|
|
|
ledge posted:Two steps is not Rube Goldberg. Rube Goldberg is: I know Batch is a bad word in lots of shops but this sounds like something I'd throw at batch if my org didn't like naked ec2s getting spun up, depending on frequency. At least a step function to avoid lambdas calling lambdas manipulating themselves.
|
|
#
¿
Jun 25, 2023 10:16
|
|
|
Latency on job begin. It’s such a stupid reason for how easy the service is to hold in your head, interact with the SDK, and build for BUT people get frustrated to the point of insanity that there can be minutes between job add and job begin. Crom help you if the service has to instantiate a new compute env, could be ten whole minutes. I wish I were joking but it’s been a sticking point more than a few times. Use it! It’s actually a great choice if you don’t already have institutional knowledge of the step function DSL.
|
|
#
¿
Jun 27, 2023 10:44
|
|
|
Maybe every place I've been was holding it wrong but SES is just hot garbage, I feel.Thanks Ants posted:Knowing what I know about the people using this service I think I'm going to push for them to move to a more managed platform that will do all this for them Very yes.
|
|
#
¿
Dec 29, 2023 01:05
|
|
|
|
| # ¿ Apr 30, 2024 14:41 |
|
|
Most go or Java programs we’ve either used layers if we needed something or the stock images. I was excited for containers for more elaborate deploys, giant runtimes or data. Would love to hear other use cases, as well.
|
|
#
¿
Mar 23, 2024 14:39
|
|