Skip to content

Cleaning, Updates, Fixes - #4

Open
to11mtm wants to merge 12 commits into
masterfrom
cleaning-aug-19
Open

Cleaning, Updates, Fixes#4
to11mtm wants to merge 12 commits into
masterfrom
cleaning-aug-19

Conversation

@to11mtm

@to11mtm to11mtm commented Feb 4, 2020 •
edited
Loading

Copy link
Copy Markdown
Owner

Update Linq2Db Version

  • Fix to allow for l2db change to null record value handling in leftjoin groupby/etc

Breaking API Changes:

  • Methods may now return optionally, and this result may be recorded. This changes the contract of IJobExecutor among others.

API Changes

  • CreateJob overloads let you pass the generated GUID in.
  • Added Async API.

Executor

  • Added ResultWriter plugin to (optionally) record results returned by jobs
  • Huge improvements to Coordinator:
    • Multiple writers/readers per Queue
      • Improves performance under a number of scenarios
      • Default is 1 reader/writer per worker. The Reader count will probably be trimmed down as it is overkill.
      • Made Call to GetJobs Non Blocking. This means JobQueueCoordinator is completely nonblocking (yay!)

RPC

  • Added MagicOnion plugins.
    • MagicOnion Plugins support both single and multi server scenarios.

Internal Changes:

  • Made a number of optimizations in the internal pipeline, specifically around Job Creation

to11mtm added 12 commits August 24, 2019 09:54
@to11mtm
wip
bb295fa
@to11mtm
- Update linq2db dependency.
83c63d0 
- Change Queries for linq2db dependency behavior change.
- Begin tablehelper work
- WIP Async (Not part of API)
@to11mtm
realtime triggering with magiconion
6eebe1f 
huge perf improvements
@to11mtm
- Made JobQueueCoordinator nonblocking on job sweeps
49b0b5b 
 - Made `SimpleInjector` package for RPC integration

 - Added Redis Streaming Server extension WIP

 -
@to11mtm
Cleanup into folders.
dcbe07b
@to11mtm
Unit Tests for Redis Hub
c8d09e6
@to11mtm
Cleaning projects/namespaces
50479e2
@to11mtm
Allow for tuning of broadcast settings.
923ba03
@to11mtm
- Added Async support to IJobQueueAdder and IJobQueueManager
7dddad9 
- GetJob now has option to require valid (i.e. new/retry) status

- Fixed Misspelling on `IContainerFactory` interface.

- Added Plugin Recovery support to execution layer.

- Improved scaling of Queue Readers/writers.

- Fixed potential race conditions on fast running jobs causing Inprogress/Processed being written out of order.

- Added WIP Async Query Actor

- Made `TimedCache` not block all timedcaches cleanup processes.

- Made `StreamingServerPlugin` Autorecoverable.
@to11mtm
Optimzations, FAQ, Notices
ee0f091 
- Made Guid Generator Sequentially based by default.
- Added Index Creation options to use Clustered indexes on JobGuid. This improves perfomance IMMENSELY.
@to11mtm
fix SequentialGuidValueGenerator so that we properly use the counter.
0b6fba4
@to11mtm
minor cleaning and improvement of SqlConnectionHelper
98c2331
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@to11mtm