Bug 939 - NLnet 2021 cavatools proposal 2021-08-071
Summary: NLnet 2021 cavatools proposal 2021-08-071
Status: RESOLVED FIXED
Alias: None
Product: Libre-SOC's first SoC
Classification: Unclassified
Component: Milestones (show other bugs)
Version: unspecified
Hardware: PC Linux
: --- enhancement
Assignee: Luke Kenneth Casson Leighton
URL: https://libre-soc.org/nlnet_2021_3mde...
Depends on: 1170 947 958 1240
Blocks: 938 1195
  Show dependency treegraph
 
Reported: 2022-10-01 17:36 BST by Luke Kenneth Casson Leighton
Modified: 2024-08-31 23:04 BST (History)
3 users (show)

See Also:
NLnet milestone: NLnet.2021-08-071.cavatools
total budget (EUR) for completion of task and all subtasks: 50000
budget (EUR) for this task, excluding subtasks' budget: 0
parent task for budget allocation:
child tasks for budget allocation: 947 958 976 979 980 981 982 983 984 985 987
The table of payments (in EUR) for this task; TOML format:


Attachments
report snapshot rfps lkcl (533.00 KB, application/pdf)
2024-07-29 10:15 BST, Luke Kenneth Casson Leighton
Details
photo of BP/HR reqding (779.05 KB, image/jpeg)
2024-07-29 11:22 BST, Luke Kenneth Casson Leighton
Details
BP after rest (503.24 KB, image/jpeg)
2024-07-29 12:17 BST, Luke Kenneth Casson Leighton
Details
BP/HR 2:41am (799.49 KB, image/jpeg)
2024-07-30 02:49 BST, Luke Kenneth Casson Leighton
Details
bp reading 21:10 after distressing message from michiel (875.54 KB, image/jpeg)
2024-07-30 21:16 BST, Luke Kenneth Casson Leighton
Details
bp reading 21:11 after distressing message from michiel (903.71 KB, image/jpeg)
2024-07-30 21:20 BST, Luke Kenneth Casson Leighton
Details
bp reading 11:00 on waking (922.69 KB, image/jpeg)
2024-08-02 11:07 BST, Luke Kenneth Casson Leighton
Details
bp reading 18:49 after distressing message from bob houdriaan (690.70 KB, image/jpeg)
2024-08-02 18:57 BST, Luke Kenneth Casson Leighton
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Luke Kenneth Casson Leighton 2022-10-01 17:36:49 BST
Introduction (part of MOU)

Developing an ASIC costs millions of dollars but there could be subtle design mistakes. A much lower-cost and faster turn-around is to have a high-performance Hardware-Cycle-Accurate simulator.  Normal simulators are too slow to be able to have real-time user interaction. cavatools is therefore specifically designed to give high performance simulation of actual hardware, allowing Hardware Architects to guage whether their Micro-Architecture will meet the end-user requirements, long before money is spent on Mask Charges.

----

(Note: bug #1039 is not part of this grant but was added after
2022-08-071 was signed, instead added to ongoing #961)

Task list

# Support missing instructions

Besides introducing prefixed instructions, SVP64 extensions also introduce many word instructions. Some simply extend vanilla PPC with the new functionality and can be used even outside of SVP64 extensions (for example, a new set of math functions). Others manipulate on SVP64 context and manipulate control flow. The support for all these instructions must also be present in binutils.

Budget: 3000 EUR
URL: https://bugs.libre-soc.org/show_bug.cgi?id=958

---------

# Switch reference assembler to machine-readable specs

We already have various machine-readable files which describe the instructions, the prefixing rules and other essential important parts. However, the current assembly code does not consider all this information, and instead duplicates some parts of it in the code, or implements some bits of the logic which should have relied on the generation. The current approach leads to code duplication and software rot; what's worse, there's a need to keep track of instructions in the code whenever these are changed in the specifications. This task intends to build the essential parts needed to make most of the assembly to be generated automatically.

Budget: 5500 EUR
URL: https://bugs.libre-soc.org/show_bug.cgi?id=947

---------

# Support missing specifiers

By the time the initial binutils support was implemented, we had no real handling for many of the branch specifiers. It was decided that we should postpone these for a while. The real support for Python assembly was implemented only in September 2022, and has not been merged into binutils since then yet.

Budget: 1500 EUR
URL: https://bugs.libre-soc.org/show_bug.cgi?id=976

---------

In scope of supporting cavatools, one of crucial pieces is instruction decoder for Power ISA. This task can re-use some of existing infrastructure of the project, relying on nMigen and insndb. It is critically important to provide the code which can be used as a standalone entity: we can and should generate some bits for this code, but it should not rely on external components other than cavatools itself.

Budget: 5500 EUR
URL: https://bugs.libre-soc.org/show_bug.cgi?id=979

---------

# Implement C-based Power ISA pseudocode compiler

Besides the actual decoding to understand which instruction we're going to simulate, we also need a way to specify the actual logic behind the instruction to be executed. We already have human-readable specification in Markdown format, and successfully used it for our reference Python-based simulator. We need to follow the same approach for cavatools, and generate the code for all PowerISA instructions.

Budget: 5500 EUR
URL: https://bugs.libre-soc.org/show_bug.cgi?id=980

---------

# Support PowerPC ABI in cavatools

Besides being able to execute PowerPC instructions in cavatools, we also need to support the PowerPC ABI to execute the real code interacting with the OS.

Budget: 4500 EUR
URL: https://bugs.libre-soc.org/show_bug.cgi?id=981

---------

# Support PowerPC ABI in ISACaller

We need to maintain the reference Python simulator, which also lacks proper userspace ABI support. The ABI support is essential for running real userspace applications.

Budget: 4500 EUR
URL: https://bugs.libre-soc.org/show_bug.cgi?id=982

---------

# Support PowerPC SFFS compliance

XXXX MUST NOT DUPLICATE WITH bug #999 ! XXXX
(resolved by focussing on cavatools having ELF dynamic library loading)

We need to continue works on Scalar Fixed-Point + Floating-Point Compliancy Subset (SFFS). The Linux distribution must be compiled and be able to run; this might be a multi-phase work due to the huge amount of packages to support.  In particular
this stage should focus more on what has to be done to cavatools to get it to
run SFFS binaries: ELF linker loading of dynamic libraries.

Budget: 6000 EUR
URL: https://bugs.libre-soc.org/show_bug.cgi?id=983

---------

# Support SVP64 in cavatools

Once we've reached the stage when we're capable of executing vanilla PowerPC instructions with cavatools, we need to extend this support with SVP64 extensions.

Budget: 8000 EUR
URL: https://bugs.libre-soc.org/show_bug.cgi?id=984

---------

# Integrate cavatools into test API

We already have a solid infrastructure for testing purposes. However, it does not support cavatools yet. In scope of these tasks, we need to integrate cavatools into our test infrastructure via pygdbmi.

Budget: 3000 EUR
URL: https://bugs.libre-soc.org/show_bug.cgi?id=985

---------

# cavatools-related administrative activities

Any task includes activities related to issue tracking and monitoring. This includes not only organizing the tasks, but also providing comments to all subtasks, participating in dicussions, budget synchronization and similar activities which rather fit the main task than any of the standalone subtasks.

Budget: 3000 EUR
URL: https://bugs.libre-soc.org/show_bug.cgi?id=987
Comment 1 Luke Kenneth Casson Leighton 2022-10-13 19:47:58 BST
system calls in power-gem5:

https://github.com/gem5/gem5/blob/stable/src/sim/syscall_emul.cc
https://github.com/gem5/gem5/blob/stable/src/arch/power/linux/se_workload.cc#L109

there will be similar in both qemu and cavatools.
Comment 2 Luke Kenneth Casson Leighton 2022-10-13 19:54:04 BST
qemu system calls:
https://github.com/qemu/qemu/blob/master/linux-user/ppc/syscall.tbl

here's how they are called:
https://github.com/qemu/qemu/blob/master/linux-user/ppc/cpu_loop.c#L336
Comment 3 Luke Kenneth Casson Leighton 2022-10-13 20:53:31 BST
very interesting!  cavatools simply passes the syscall directly
to the host operating system, in assembler

https://www.felixcloutier.com/x86/syscall.html
https://github.com/phaa-eu/cavatools/blob/main/uspike/proxy_syscall.cc#L57
Comment 4 Luke Kenneth Casson Leighton 2022-10-13 22:43:38 BST
scary!
https://stackoverflow.com/questions/37032203/make-syscall-in-python
Comment 5 Dmitry Selyutin 2022-10-13 22:45:52 BST
Well, good news is, I did this a lot, there's nothing new here. :-)
Comment 6 Luke Kenneth Casson Leighton 2022-10-14 18:01:17 BST
(In reply to Dmitry Selyutin from comment #5)
> Well, good news is, I did this a lot, there's nothing new here. :-)

i think the python version should do full syscall emulation
rather than attempt to proxy to real ones.

the only reason proxy works in cavatools is because it is using
*actual* userspace memory (!)

for ISACaller any "memory" is entirely emulated.
Comment 7 Dmitry Selyutin 2022-10-14 18:18:44 BST
(In reply to Luke Kenneth Casson Leighton from comment #6)
> the only reason proxy works in cavatools is because it is using
> *actual* userspace memory (!)

This sounds really creepy.

> for ISACaller any "memory" is entirely emulated.

This is the way to go.
Comment 8 Jacob Lifshay 2022-11-26 00:27:12 GMT
imho eur 6000 for the pseudocode to C compiler is fine, don't let our discussion about what exactly we should do for that task block submitting to nlnet.
Comment 9 Luke Kenneth Casson Leighton 2022-11-26 05:09:46 GMT
(In reply to Dmitry Selyutin from comment #7)
> (In reply to Luke Kenneth Casson Leighton from comment #6)
> > the only reason proxy works in cavatools is because it is using
> > *actual* userspace memory (!)
> 
> This sounds really creepy.

it's how cavatools gets 250 million instructions per second
per process per host core, where other emulators are a minimum of
20x slower and flat-out incapable of multi-core support!

peter hsu did not design cavatools to be "pretty and nicey-nicey",
he designed it to give developers of applications a good chance at
*real-time* high-performance computationally-extreme emulation, so
that you can test an application *in full*, iteratiely adding new
instructions and new micro-architectures, getting the design right
before dropping 16 to 32 ***MILLION*** dollars on Mask Charges,
only to find that you utterly screwed up.

this is not qemu. we are not in kansas no more.

> > for ISACaller any "memory" is entirely emulated.
> 
> This is the way to go.

in ISACaller yes. and we can expect performance to degrade
even further than it already is.  however, we get readable
code.
Comment 10 Dmitry Selyutin 2022-12-08 19:03:01 GMT
I dropped all the links from the overall task description to keep it reduced to a task list. Any reader should carefully check the entire task discussion anyway, so here these links are:

https://libre-soc.org/nlnet_2021_3mdeb_cavatools/
https://github.com/phaa-eu/cavatools
https://www.bsc.es/research-and-development/software-and-apps/software-list/cavatools
Comment 11 Dmitry Selyutin 2022-12-10 10:40:02 GMT
Updated the milestones for the subtasks. What should be the next step?
Comment 12 Dmitry Selyutin 2022-12-11 16:50:21 GMT
Ping to all interested parties.
Comment 13 Luke Kenneth Casson Leighton 2022-12-11 17:09:22 GMT
(In reply to Dmitry Selyutin from comment #11)
> Updated the milestones for the subtasks. What should be the next step?

i thought it might be sensible to put a "management" budget on here,
part for you writing the mou, part for me, and part for future
updates to budget-sync and other odds.

my feeling is that cavatools eabi is going to be near-trivial,
it can come down to EUR 4000.  management can be EUR 3000, that
leaves EUR 1000 which can go into one or more other tasks which
are abit low. #976 and #958?
Comment 14 Dmitry Selyutin 2022-12-12 18:50:10 GMT
(In reply to Luke Kenneth Casson Leighton from comment #13)
> (In reply to Dmitry Selyutin from comment #11)
> > Updated the milestones for the subtasks. What should be the next step?
> 
> i thought it might be sensible to put a "management" budget on here,
> part for you writing the mou, part for me, and part for future
> updates to budget-sync and other odds.

Fair enough, I agree, but with a remark below.

> my feeling is that cavatools eabi is going to be near-trivial,
> it can come down to EUR 4000.  management can be EUR 3000, that
> leaves EUR 1000 which can go into one or more other tasks which
> are abit low. #976 and #958?

I also have a strange feeling that works around integration will need more resources, too. I'm not the one to judge, since I haven't checked this part yet, but I'd be really surprised if integrating cavatools to our testing API would be trivial. But I'm afraid this is to be discovered yet. I'm unlikely to do it due to time constraints, but others will almost certainly handle it. How about the scheme below?

1. Cut ABI tasks to 4500 EUR each (#981, #982).
2. Since we now have 5000 EUR, we can assign 3000 EUR to management, 500 EUR to #976, 500 EUR to #958, and 1000 EUR for wrapup which can migrate to #985 if possible?

Or we can assign 1000 EUR #985 immediately if you can confirm this is a difficult one. I'm not sure of the level of gdb support we have now.

If OK, I will raise the management task with 3000 EUR, will assign 500 EUR to each #976 and #958, and will move the 1000 EUR to either wrapup or #985, depending on our conclusions.
Comment 15 Dmitry Selyutin 2022-12-12 18:54:21 GMT
TL;DR: I feel that #985 is underestimated too; please let me know your opinion.
Comment 16 Luke Kenneth Casson Leighton 2022-12-13 09:05:39 GMT
(In reply to Dmitry Selyutin from comment #14)

> Fair enough, I agree, but with a remark below.

ack

> > my feeling is that cavatools eabi is going to be near-trivial,
> > it can come down to EUR 4000.  management can be EUR 3000, that
> > leaves EUR 1000 which can go into one or more other tasks which
> > are abit low. #976 and #958?
> 
> I also have a strange feeling that works around integration will need more
> resources, too. I'm not the one to judge, since I haven't checked this part
> yet, but I'd be really surprised if integrating cavatools to our testing API
> would be trivial.

yes, very.  cavatools already supports gdbmi - gdb remote machine interface.
a new register-set-definition is needed, but that's needed anyway.

> But I'm afraid this is to be discovered yet. I'm unlikely
> to do it due to time constraints, but others will almost certainly handle
> it. How about the scheme below?
> 
> 1. Cut ABI tasks to 4500 EUR each (#981, #982).

ahh ISACaller ABI is *not* trivial: unlike cavatools which thunks directly
onto existing EABIs with a trivial shim (so as to get absolute max performance)
ISACaller has to implement a **FULL** and **TOTAL** implementation... in python.
there _may_ be an existing implementation out there but finding it will be a
pig: try searching "linux abi implementation in python"

> 2. Since we now have 5000 EUR, we can assign 3000 EUR to management, 500 EUR
> to #976, 500 EUR to #958, and 1000 EUR for wrapup which can migrate to #985
> if possible?

sure.

> Or we can assign 1000 EUR #985 immediately if you can confirm this is a
> difficult one. I'm not sure of the level of gdb support we have now.

full remote gdb machine interface is in cavatools.  but only RV. not ppc64le.
 
> If OK, I will raise the management task with 3000 EUR, will assign 500 EUR
> to each #976 and #958, and will move the 1000 EUR to either wrapup or #985,
> depending on our conclusions.
Comment 18 Dmitry Selyutin 2022-12-13 19:01:07 GMT
Upd: comment #17
Comment 19 Dmitry Selyutin 2022-12-13 19:50:47 GMT
Upd: assigned 1000 from wrapup to cavatools test API support (1000 EUR from #939 => #985)
Comment 20 Luke Kenneth Casson Leighton 2023-01-29 12:13:15 GMT
(In reply to Dmitry Selyutin from comment #17)
> https://bugs.libre-soc.org/show_bug.cgi?id=939: 0 => 1000 (this task)

really, that EUR 1000 should be in the management task.
but you've not put a subtask budget for it.

i'm re-running budget-sync to check things.

ERROR:root:Total budget assigned to payees (cf_payees_list) doesn't match expected value: bug #987, calculated total 500, expected value 3000
ERROR:root:Bug's assigned milestone doesn't match the milestone assigned to the root bug: descendant bug #988, root bug #961

yep you've assigned EUR 500 to yourself but the remaining EUR 2500
is unassigned *within* that task.

what instead must be done is to create a sub-task of #987.
Comment 21 Luke Kenneth Casson Leighton 2023-01-29 12:21:33 GMT
(In reply to Luke Kenneth Casson Leighton from comment #20)

> what instead must be done is to create a sub-task of #987.

done, sorted. i double-checked the comment #0 totals, they're
EUR 50,000.  i'll send comment #0 as the Schedule A to Michiel,
along with a JSON file.
Comment 22 Luke Kenneth Casson Leighton 2023-10-06 09:52:25 BST
andrey you added two extra tasks, remember to let people know by putting
the commit diff link here

https://git.libre-soc.org/?p=libreriscv.git;a=commitdiff;h=a3f5eea083
Comment 23 Luke Kenneth Casson Leighton 2024-07-19 12:07:48 BST
report on cavatools project.

background:

luke leighton has been subjected for 16 years to domestic verbal abuse,
fleeing for his life from his home on 11 sep 2023. an online article
on the chronic damage caused by narcissim is here:

  https://www.drlamcoaching.com/blog/adrenal-fatigue-and-narcissism/

the article outlines a number of key severely debilitating physical
health conditions, the main effects being NEUROLOGICAL damage, and
zero tolerance to stress. luke now also has PTSD, in addition to
Autism, and also has chronic recurrent glandular fever.

the combination of Chronic Adrenal Fatigue and autism is extreme in its
consequences, if distressed: IMMEDIATE shock occurs, which combined with
the glandular fever (triggered by cortisol, the stress hormone), results
in near-instantaneous throat constriction sufficient to make breathing
extremely difficult, in some cases requiring hard pressure on his windpipe
to temporarily alleviate. summary: stress places luke at risk of DEATH.

virtually nobody who has not directly witnessed this phenomena, and even
some who have, have any understanding and simply do not believe it is
either possible, or in some instances do not believe that the medical
diatress is actually occurring, even as luke is desperately struggling to
stay alive. there are now over 200 instances of risk of death by choking,
many of them video'd and documented.

NLnet i regret to report is amongst the people who have not taken this medical
phenomena into consideration, despite repeating it well over twenty times
to them. they are also aware of the "word" autism but have made no
adjustments to their communications protocols to take the risk of medical
distress, nor the possibility of death caused by the combination of CFS
Autism Glandular Fever and PTSD, into consideration.

with that background in mind the report can proceed, bearing in mind that
the effects of the Domestic Verbal Abuse by RAYMOND, as well as complete
lack of empathy by BHARVANI MARGARITIS CALDERWOOD and LEWIS, had a massive
adverse impact on luke's ability to lead the team, resulting in significant
communications failures and additinal distress for that team, losing team
members and requiring a significant adjustment to the goals achievable.

report

the original target was to port the c-based program, cavatools, to Power ISA.
the amount of money requested turned out to be much smaller than the size of
the project, in relation to the skill of available people.

the original estimates involved cavatools primary author helping to do the
port. unfortunately, the author was unable to help with the instruction
decode phase, and the project had to be shelved until someone with the
necessary expertise emerged. a second person only emerged with the skill
and expertise around october 2023.

unfortunately, this person has a significantly higher cost, which meant
that it was simply immediately impossible to achieve the original target,
because the target had been costed for the original author of cavatools
*only*.

a meeting was therefore arranged, and NLnet informed, that the project
would adapt to focus on the python-based simulator (ISACaller), and
on a drastically smaller subset of system calls. unit tests would also
be written that could later be used on a subsequent grant, focussed more
on the c-based cavatools, bootstrapping it by now checking against
known-good unit tests (using the python-based  simulator).

all of these adapted (expanded) goals, which were part of the original
objective and the original application (but not its sole objective) were
successfully achieved.

interestingly no changes were required to the milestones themselves:
the original grant application needed no adaptation: it was just that
within the flexibility of the definition of the milestones it was
possible to focus more on the python-based simulator.

however there is also something very important about the way that the
objectives were achieved: as much as possible was *done in c*. a
*c* based Power ISA decoder (as a general-purpose library) was written.
this meant that a future grant for the c-based cavatools could utilise that
c-based general-purpose library.

in all, despite the medical difficulties faced by luke (which he was
simply not aware of in any way at the time), the grant was definitely
successful. 

summary: sadly, team members were lost along the way due to harrassment
and ongoing stalking, and the mental health of everyone on the team
seriously adversely affected, but the objectives within the milestones,
which did not need changing, were successfully met.
Comment 24 Luke Kenneth Casson Leighton 2024-07-25 12:10:35 BST
Date: Sat, 20 Jul 2024 01:50:18 +0200
From: Michiel Leenaars <michiel@nlnet.nl>
To: Luke Kenneth Casson Leighton <lkcl@lkcl.net>
Subject: Re: Re: Get well

Dear Luke,

(dropping Brian to bcc, this is outside of the scope for him)

Thanks for initiating the writeup. This is a step in the right direction.

any embarrassment caused by your STATEMENT "you have not
achieved the goals" i cannot help you with. you should
have listened and ASKED THE QUESTION:

"it seems that you have not met the deliverables.
 have i missed anything here? what actually happened?"

Am I correct in interpreting that you suggest you are quoting us saying "you have not achieved the goals"? Where precisely did you get this statement from?

We did write:

"For each pending payment request, please ensure there is a final comment in the issue tracker indicating where to find the concrete outcome of the task, along with a description and justification of any deviations from the original description. We have attempted to understand your progress, but it is currently opaque and lacks the previous level of structure."

What is precisely accusatory in what we wrote? We only ask for clarification, in the clear absence of a wrap up of most invidual tasks and of the project as a whole. What did you find unreasonable in that?

Now on the substance:

What do you hope to gain by adding your medical and relational history in a public document that is intended as serious proof of work? This isn't about you, for that I suggest establishing a personal blog if need be (in general I would recommend to keep such personal matters outside of the public sphere, as they might block future efforts). This should be a wrap-up of the work from the Libre-SOC team, and as a project lead we expect you to keep the wrap-up professional, factual and on topic. Accusations to e.g. your ex-wife or former colleagues do not belong here, or in fact anywhere on the issue tracker/mailing list/etcetera. Could you please clean this up?

The bit under "report" is the only relevant part, but it is not much more than a narrative timeline of how you experienced the project and some decisions made along the way. These may be relevant, but should be added to the individual bugs the payment requests point to instead of this bug that noone will read. This narrative timeline isn't precisely what we would need to wrap up the project though. We need _documentation_ on Libre-SOC.org, explaining e.g. what the c based Power ISA decoder does, where it can be found, how this should (and should not) be used, etc. Very likely you have most of this info somewhere and/or in your head, but the world (including us) just doesn't know where to find it, which prevents us from being able to benefit from your collective work - until you connect the dots. Can you help us by providing such documentation, at a level of professionality matching the significant budget? And can you also make sure that the repo's contain the right information on how to compile, which dependencies are needed, etc?

In other words: can you help translate the outcomes to the target audience, in line with the fact that this concerns tax payer money.

Best,
Michiel
Comment 25 Luke Kenneth Casson Leighton 2024-07-25 12:48:20 BST
To EC Commission and to Auditors: i am still recovering from
abuse and still have a stalker. below you can see that
Michiel Lenaars of NLnet is unable to take into consideration
the true extent of the damage done to my health. he and
Bob Goudriaan have both been informed repeatedly that i have
nearly died multiple times as a result of the abuse, but
they are unable to appreciate or acknowledge the seriousness.
i will attempt to answer inline below, but if it becomes
too distressing i will have to stop, recover, and carry on
another time: for example, recalling and relating the abusive
events when giving statements to the police *caused* medical
distress and caused phyisical collapse, every single time.
i cannot continue to let that happen: i need to recover from
the medical physical effects of the abuse. my recovery is
underway but in all seriousness that recovery is very sadly
impeded by NLnet not listening. i have attempted to engage
Medation services (Brian, Technology Cultivation) but they
are not listening to me telling them how distressing that it
is that they are not listening, and refused repeatedly to
engage Mediation to help get across to them how much harm
it is causing to my physical health recovery that they are
not listening.

i leave it at that and will begin answering below.

(In reply to Luke Kenneth Casson Leighton from comment #24)
> Date: Sat, 20 Jul 2024 01:50:18 +0200
> From: Michiel Leenaars <michiel@nlnet.nl>
> To: Luke Kenneth Casson Leighton <lkcl@lkcl.net>
> Subject: Re: Re: Get well
> 
> Dear Luke,
> 
> (dropping Brian to bcc, this is outside of the scope for him)
> 
> Thanks for initiating the writeup. This is a step in the right direction.
> 
> any embarrassment caused by your STATEMENT "you have not
> achieved the goals" i cannot help you with. you should
> have listened and ASKED THE QUESTION:
> 
> "it seems that you have not met the deliverables.
>  have i missed anything here? what actually happened?"
> 
> Am I correct in interpreting that you suggest you are quoting us saying "you
> have not achieved the goals"?

yes.

this is literally the first clarifying question that you have ever asked.

> Where precisely did you get this statement
> from?

read bob's (currently private) message again.

> We did write:
> 
> "For each pending payment request, please ensure there is a final comment in
> the issue tracker indicating where to find the concrete outcome of the task,
> along with a description and justification of any deviations from the
> original description. We have attempted to understand your progress, but it
> is currently opaque and lacks the previous level of structure."

that is because i am recovering from deep trauma and shock which has
caused organ damage as well as neuro-physiological damage.
i have informed you of this repeatedly.
 
> What is precisely accusatory in what we wrote? We only ask for
> clarification, in the clear absence of a wrap up of most invidual tasks and
> of the project as a whole. What did you find unreasonable in that?

you have misunderstood.

the failure on your part to listen was well before you asked for this.



> Now on the substance:
> 
> What do you hope to gain by adding your medical and relational history in a
> public document that is intended as serious proof of work?

asking what i "hope to gain" is not an appropriate question, it is shockingly
insulting and a distressing accusation that i somehow "benefit".

as an autistic adult whom you have been informed many times that i am
disabled as a result of that autism, i need you rephrase this question
so that it does not start with a distressing accusation.

if you are not familiar with how to ask questions of autistic adults
so that you do not put them into distress, please look it up or
engage the urgent services of Brian (as i have asked you to do 
for two weeks now) so that i can safely explain it to him, and he
can explain it to you.

> the wrap-up professional, factual and on topic. Accusations to e.g. your
> ex-wife or former colleagues do not belong here, or in fact anywhere on the
> issue tracker/mailing list/etcetera. Could you please clean this up?

please clarify:

1. are you asking me to censor reports?
2. are you asking me to censor bugreports?
3. are you asking me to censor the  mailing list?
4. are you asking me to censor anything else?

i cannot continue for today, i am overwhelmed by answering and need to
recover so as not to damage my physical and neuro-physiological health.
Comment 26 Luke Kenneth Casson Leighton 2024-07-25 14:35:09 BST
michiel has just demanded that i censor the discussion, here.
the project has always operated on full transparency.
for the very first time ever he has demanded that the
discussion remain private, which if he had informed me of
i would have refused to do.

i have declined hs demand to engage in censorship, and am
now in considerable distress, even more so than when i replied
above.

i was with friends, engaging in social discussion as a way to
keep endorphin levels up (a necessary part of recovery from abuse)
when i read his demand to engage in censorship. it has put me into
shock, caused a massive adrenaline spike of fear, which now has
me shaking, and i do not know what to do.

i am going to lie down now, attempt to sleep in order to recover
from the adrenal shock and fear.
Comment 27 Luke Kenneth Casson Leighton 2024-07-25 19:41:31 BST
nlnet have made it clear that if i do not do what they demand, they will
cease and terminate all communication.

my autistic disability prohibits me from complying with their demand,
even when the financial consequences to me are catastrophic.

i do not understand why they have been unable to listen for weeks, now.
Comment 28 Luke Kenneth Casson Leighton 2024-07-26 10:42:23 BST
one week ago i requested of the Director of NLnet the contact details
of the EC and the Auditor. i was told by the Director, words to the effect
"i doubt the EC would listen" and the contact details were not given.

i have made a second request.

i have not received a response.
Comment 29 Luke Kenneth Casson Leighton 2024-07-28 12:04:54 BST
background: i have woken up pre-dawn, and had a fantastic
magical time watching the sunrise this morning. it is a lovely
sunny day and i thought, "i can continue replying". however
immediately on picking up my tablet and typing in the URL
to enter this reply, "butterflies" hit (adrenaline spike)
which i know means i am fearful of continuing this conversation,
and so *must* keep it short.

(In reply to Luke Kenneth Casson Leighton from comment #24)
> Date: Sat, 20 Jul 2024 01:50:18 +0200
> From: Michiel Leenaars <michiel@nlnet.nl>

> any embarrassment caused by your STATEMENT "you have not
> achieved the goals" i cannot help you with. you should
> have listened and ASKED THE QUESTION:

(context: this was *me* stating this, in desperation, when both
bob and michiel made an accusation "you haven't achieved the goal".
as an autistic - disabled - adult this was terribly distressing
as i am prohibited from contradicting other peoples' false statements,
due to the conflict and distress it causes)


> We did write:
> 
> "For each pending payment request, please ensure there is a final comment in
> the issue tracker indicating where to find the concrete outcome of the task,

given the abuse - which you have stated very clearly is not relevant,
are are *not listening* when i tell you repeatedly and desperately that
it is *extremely* relevant - this is just not practical in any way.

i said to you that you need to ask QUESTIONS.

you should have said, "is it possible, given the abuse that you have been
subjected to, that you can [ensure there is a final comment...] ?"

and the answer to that question, which you DID NOT ASK, is, realistically
"no", and i will now explain why.

> along with a description and justification of any deviations from the
> original description. We have attempted to understand your progress, but it
> is currently opaque and lacks the previous level of structure."

]yes, because DUE TO THE ABUSE i have been unable to focus, have memory
problems, organisation and planning difficulties, and much more. all
of it is documented here, as being damage to the Neuro-affect Circuit
https://www.drlamcoaching.com/blog/adrenal-fatigue-and-narcissism/

    Imbalances in this circuit can cause symptoms such as:

        * Mood disorders like anxiety and depression
        * Disordered and negative thinking
        * Neurodegeneration or the loss of neurons,
          bringing on age-related chronic conditions
        * Lowered stress tolerance
        * Feelings of impending doom
        * Poor sleep

     If you experience these symptoms as a result of AFS,
     it can complicate and worsen any issues that you’re suffering
     because of a narcissistic relationship. It will also impede your
     recovery and healing. This is why it’s so important that you
     understand the connection between adrenal fatigue and narcissism.

these are extremely serious symptoms, but the article in no way gives
the full picture.

* CALDERWOOD damaged relations between team members by refusing to leave
  a team meeting. he quit shortly after, taking knowledge which allows
  your question to be answered accurately and adequately AWAY from the
  project.  DUE TO THE ABUSE I WAS SUBJECTED TO, he NO LONGER REPLIES
  and i do not know exactly what he did.

* DUE TO THE ABUSE I WAS SUBJECTED TO, i was in such deep traumatic shock
  that i had to stop going on the project's IRC channel, leaving everyone
  in the team with no social cohesion or real-time technical advice.
  this in turn meant that even though *i* knew what was needed, the people
  who were less experienced were struggling with the tasks, and did not
  know to put in a "final report comment" for example.

> In other words: can you help translate the outcomes to the target audience,
> in line with the fact that this concerns tax payer money.

i have written too much above, placing me at risk by recalling traumatic
events which i know from experience it is dangerous to relate, so i have to
once again stop very soin

the honest and serious answer is: DUE TO THE ABUSE, the answer is "no i
personally on my own without serious help, cannot do so, even if it means
that i end up in serious financial jeapordy as a direct result of being
unable to answer".

as i said in the voicemail message left with you on friday (which i recorded and
will place publicly online later), we *desperately need a different approach*
to ensure that i am not placed at risk, do not feel threatened, feel safe,
and can still as best is possible get you the answers that will satisfy
an Auditor.

summary: i have been attempting to emphasise for weeks now that you are
drastically underestimating the medical and physical effects of the ABUSE
on myself as a DISABLED autistic adult.

i have to go now.
Comment 30 Luke Kenneth Casson Leighton 2024-07-29 10:15:10 BST
Created attachment 209 [details]
report snapshot rfps lkcl

my bank account is now down to GBP 1,500.

as of today (and as of 2 weeks ago when nlnet ceased listening and began
making statements and demands), the amount outstanding on RFPs is EUR 41,000

due to NLnet not listening on the medical consequences of the ABUSE, i will
have to stop buying food in approximately one week.
Comment 31 Luke Kenneth Casson Leighton 2024-07-29 11:00:59 BST
https://youtu.be/ei5DqqEgM2A

i attempt to get through to michiel, he does not listen.

he *tells* me things instead of listening, which puts
me into further shock and distress, as his behaviour
is exactly the same as my narcisstic ex-partner, who
used to shout at me instead of listening, thousands of
times.

he tells me "you got thrown off mailing lists" instead
of asking "WHY did you get thrown off mailing lists"
(A: because they turned out to be abusive individuals,
UNABLE TO LISTEN, and the way they treated me so shockingly
badly revealed that publicy, often for the very first time)

he says "you can get other team members to help" when due to
abuse harrassment and stalking *there are none*. he does not
ask QUESTIONS, simply makes STATEMENTS.

again.

i requested again today (3rd time) the contact details of the
EC Commission and the EC Auditor, after still not receiving
a response.

i am now much calmer having been in such serious distress,
(BP 131/90 at a heart rate of 62), but will need further
sleep and rest, for the rest of the day. i will in no way
be able to "answer questions".



https://www.drlamcoaching.com/blog/adrenal-fatigue-and-narcissism/
https://bugs.libre-soc.org/show_bug.cgi?id=939
https://theconversation.com/how-autistic-and-non-autistic-people-can-understand-each-other-better-234320
https://www.crnhq.org/cr-kit
Comment 32 Luke Kenneth Casson Leighton 2024-07-29 11:22:10 BST
Created attachment 210 [details]
photo of BP/HR reqding

BP/HR reading after calling my mother to attempt to get through to michiel:
BP 149/102 HR 69
Comment 33 Luke Kenneth Casson Leighton 2024-07-29 12:17:00 BST
Created attachment 211 [details]
BP after rest

i managed to get appx 40 minutes dozing,
BP is now 121/87 at a HR of 72.
Comment 34 Cesar Strauss 2024-07-30 01:44:12 BST
Dear Luke,

Tobias and I wrote a letter to Michiel over the weekend, which fortunately was well received. As a result, there is clearly no demand to remove any of what is written, in the comments above.

In addition to what you already provided, I was tasked by Michiel with organizing the relevant information related to the Python Simulator in a Web Page, easily accessible, without having to follow references to many separate places. I find this reasonable, and a benefit to the project.  I know it will demand work, unpaid, but I don't mind. The information is all there, there's nothing new. And I know I can count with support from other members of the Libre-SOC team. I'm thinking about a kind of User's Guide to the Simulator, on the wiki, with sections like "Overview", "Installation", "Getting Started", "Examples" and "API Reference".
Comment 35 Luke Kenneth Casson Leighton 2024-07-30 02:18:39 BST
(In reply to Cesar Strauss from comment #34)
> Dear Luke,
> 
> Tobias and I wrote a letter to Michiel over the weekend, which fortunately
> was well received. As a result, there is clearly no demand to remove any of
> what is written, in the comments above.

i am so rwlieved, thank you.

> In addition to what you already provided, I was tasked by Michiel with
> organizing the relevant information related to the Python Simulator in a Web
> Page, easily accessible, without having to follow references to many
> separate places. I find this reasonable, and a benefit to the project.  I
> know it will demand work, unpaid, but I don't mind. The information is all
> there, there's nothing new. And I know I can count with support from other
> members of the Libre-SOC team. I'm thinking about a kind of User's Guide to
> the Simulator, on the wiki, with sections like "Overview", "Installation",
> "Getting Started", "Examples" and "API Reference".

thank you cesar. do check in the "docs" directory as you will find that
much is already there.
Comment 36 Luke Kenneth Casson Leighton 2024-07-30 02:49:41 BST
Created attachment 212 [details]
BP/HR 2:41am

BP 120/75 HR 66
this is a normal healthy reading despite being at 2:41am.
a difference of 45 between systolic and diastolic is
also very good. previous reading (149/100) is abnormally
high and indicates severe distress.

https://www.nhs.uk/health-assessment-tools/check-your-blood-pressure-reading

it says "it is very high. check with your GP"

unfortunately my GP has been so abusive - accusing me of "faking symptoms"
(i have a recording of them stating that, twice, putting me into autistic shock)
that it is becoming dangerous to comply with the advice given *by the NHS*.
Comment 37 Luke Kenneth Casson Leighton 2024-07-30 03:37:23 BST
(In reply to Luke Kenneth Casson Leighton from comment #35)

> thank you cesar. do check in the "docs" directory as you will find that
> much is already there.

https://libre-soc.org/docs/
https://libre-soc.org/docs/pypowersim/
https://libre-soc.org/docs/firststeps/

pypowersim page is already there.
Comment 38 Luke Kenneth Casson Leighton 2024-07-30 21:16:03 BST
Created attachment 213 [details]
bp reading 21:10 after distressing message from michiel

BP 131/91 HR 71 after distressing message from michiel
Comment 39 Luke Kenneth Casson Leighton 2024-07-30 21:20:25 BST
Created attachment 214 [details]
bp reading 21:11 after distressing message from michiel

BP 131/95 HR 69 after distressing message from michiel.
took two readings as i was in such distress the
machine failed to takecreadings, fourtimes.

again he has not been listening.
statement of judgement "i am my own worst enemy",
refusing to provide EC Complaints contact details
failing to understand that criminal abuse has taken place

failing to ASK QUESTIONS when the WORK HAS BEEN DONE
and PROOF AND DOCUMENTATION ALREADY EXISTS.
Comment 40 Cesar Strauss 2024-07-31 01:58:32 BST
Indeed, I find it was an unfortunate choice of words for Michiel to write you. Do you want me to write him another letter?

So, given the contents of the "docs" directory, do you think that a User's Guide like I proposed is a redundant and unnecessary duplication? Do these wiki pages together already cover most topics about the simulator? There's any way they can be further improved, somewhat?
Comment 41 Luke Kenneth Casson Leighton 2024-07-31 10:36:51 BST
(In reply to Cesar Strauss from comment #40)
> Indeed, I find it was an unfortunate choice of words for Michiel to write
> you.

given the distress *again* it caused - it was much more than unfortunate,
it indicates a fundamental lack of empathy and an unwillingness to listen.

> Do you want me to write him another letter?

yes please.

it was deeply insensitve of him, and has triggered a recurrence
of a viral infection. with doctors accusing me of FAKING SYMPTOMS it is
simply too dangerous for me to go near them, his response puts me
into further danger.

> So, given the contents of the "docs" directory, do you think that a User's
> Guide like I proposed is a redundant and unnecessary duplication?

absolutely.

> Do these
> wiki pages together already cover most topics about the simulator?

yes. how to use it, how to modify it, how to change instructions, how
to add instructions, it's all there. makefile example is here
https://git.libre-soc.org/?p=openpower-isa.git;a=tree;f=src/test/basic_pypowersim;hb=HEAD

the approach michel is taking is so aggressive to me and so non-empathetic
that he is not able to listen when i tell him that.

i don't understand why.

> There's
> any way they can be further improved, somewhat?

one addition could be an example of running userspace, but there is no
way to do that from commandline.

right now there is a unit test file demonstrating syscalls
https://git.libre-soc.org/?p=openpower-isa.git;a=blob;f=src/openpower/decoder/isa/test_syscall.py;hb=HEAD

it was written by dmitry:
https://git.libre-soc.org/?p=openpower-isa.git;a=history;f=src/openpower/decoder/isa/test_syscall.py;hb=HEAD

who will have submitted it ALREADY with his RFP which has ALREADY BEEN PAID
so there is NO NEED TO DEMAND IT BE FURTHER DOCUMENTED.

which tells you how badly michiel is not actually listening to me.
Comment 42 Luke Kenneth Casson Leighton 2024-07-31 10:57:05 BST
https://youtu.be/Wbh2QzIAfP0
i've restricted this video to "18+ only" because it is very distressing.
Comment 43 Luke Kenneth Casson Leighton 2024-08-02 11:07:58 BST
Created attachment 215 [details]
bp reading 11:00 on waking

BP 114/89 HR 65 on waking, checked at
https://www.nhs.uk/health-assessment-tools/check-your-blood-pressure-reading/result

says "your BP is high, get it checked by doctor or clinician".
Comment 44 Luke Kenneth Casson Leighton 2024-08-02 18:57:54 BST
Created attachment 216 [details]
bp reading 18:49 after distressing message from bob houdriaan

via an intermediary i just received another distressing message, this time
from bob goudriaan. in it he states "incredulity" and "unprofessionalism"
due to the abuse i have been subjected to, that it "extends to an ex-wife,
ex-colleagues, police, medical professionals and elected offcials".

after reading this shocking message twice i broke down sobbing in distress,
and took another BP reading. BP 145/107 HR 83. i have checked on the nhs website
and it says to call 111 immediately.

after stopping crying i have taken a second reading, it is BP 116/80 HR 77
which is also not good because there should be a 40 point minimum difference
(116-80=36)
Comment 45 Cesar Strauss 2024-08-31 23:04:45 BST
(In reply to Luke Kenneth Casson Leighton from comment #41)
> (In reply to Cesar Strauss from comment #40)
> > So, given the contents of the "docs" directory, do you think that a User's
> > Guide like I proposed is a redundant and unnecessary duplication?
> 
> absolutely.
> 
> > Do these
> > wiki pages together already cover most topics about the simulator?
> 
> yes. how to use it, how to modify it, how to change instructions, how
> to add instructions, it's all there. makefile example is here
> https://git.libre-soc.org/?p=openpower-isa.git;a=tree;f=src/test/
> basic_pypowersim;hb=HEAD

Given the above, I've sent a letter to NLNet pointing out the URLs Luke found:

https://libre-soc.org/docs/pypowersim/
https://libre-soc.org/docs/firststeps/

I did receive positive feedback from that. However, as I understood it, I was asked to explain how Pypowersim relates to Cavatools, and how the Milestones relates to the code. This seemed pretty much what Luke already wrote in his report, here at https://bugs.libre-soc.org/show_bug.cgi?id=939#c23, so I just took what I needed. Not to clash too much with the page contents, and to avoid too much duplication, I choose to set up a brief Appendix, where any one interested can find what the original goal was, reason for adopting a new goal, and how actions were taken to bridge the gap for someone to build a high-performance C-based simulator, eventually.

The added information can be seen at the end of:
https://libre-soc.org/docs/pypowersim/