Report on quality monitoring during the following period: 01.12.2013-30.11.

2015
In the project "Literacy Cubed - Focus on Roma Families" (LIT3), WP2, "Quality
Assurance" pack leader Learn & Vision Association (ALV) Romania has proposed the
following:
I.
Aims and Objectives
Aim: to develop and set up the implementation of the quality assurance system
Objectives:
Develop tools for quality assurance
Monitoring the quality of activities
Evaluation and improvement of the project implementation
II.

Elaborated Instruments.

To this end, subject to our discussion and approved by the leading project
management and partner organizations during the first meeting of the project
(Podgorica, Montenegro, 30.01.-02.02.2014) the following were discussed : quality
assurance plans structure (Quality Assurance Plan) quality assurance strategy
structure (M & E strategy and tools) communication procedures at the project level.
In the next period, as a detailed planning of the structure was elaborated, other plans
were made for packages no.1,2,3,4,5,6,7,8 and finally, the other two documents: M &
E strategy and Tools and Communication procedures were completed.
Progress in implementing M&E strategy
WP
and Output
deliverables
indicators

Attainment level (AL)

We
accomplished
little but we
search
solutions (1)

We are on
our way to
establish
good
practice(2)

Evidence
We
already
have good
practice(3)

Actions for
improvement
(to be filled
in only if AL
is 1 or 2)

Results of proposed improvement solutions (to be filled in only starting with 2nd interim
report)

Online questionnaire : Assessment Questionnaire Project meetings

Grid for evaluation of the quality of curriculum based on which the

quality of Family Literacy curriculum was analyzed
(Cluj-Napoca, June
2014)
Quality analysis grid of the revised curriculum as a result of feedback
received from partners following the implementation of curriculum for
Family Literacy in RO, and SK MN in July-August of 2014
Grid to analyze texts used to establish texts that are to be used in
implementing the curriculum in Family Literacy workshops for families in
the target group in the following 3 countries: Montenegro, Romania,
Slovakia (Cluj-Napoca, June 2014) Curriculum demonstrations .
Observation grid.
The instrument was made during the project meeting from Cluj-Napoca
(June 2014) in order to use it in the monitoring activities of the conducted
workshops in the 3 countries in July-August 2014
.
Self-assessment/assessment questionnaires of the output indicators in
order to measure the achievement after the first year of the project in all
packages and all partner organizations. The instrument was elaborated
starting from the quality targets from the Quality assurance plan of each
package and reported output indicators for activities / deliverables of M &
E strategy and tools.
Questionnaires evaluating the effectiveness of international meetings
Project.

III. Activities which were carried out :

Implemented activities:
Communication and consultation between the project partners (according to
Communication procedure)

Individual Feedback granted to the leaders after drawing up the three interim
reports (June and November 2014, June 2015).
Conducting online interviews during the 4 project meetings Podgorica (Febr.
2014), Cluj-Napoca (June 2014), Bratislava (November 2014), London
(February 2015) and the final conference (Cluj-Napoca, in September. 2015);
Interpretation and analysis of results.
Application Grid tools for evaluation of the quality of curriculum and Grid in
order to analyze texts during the project meeting which took place in ClujNapoca, June 2014; Interpretation and analysis of results
Using Curriculum tool demonstrations during the monitoring activities for the
family literacy workshops held in Montenegro, Romania, Slovakia, in July and
August 2014.
Observation grid.
The final conclusions of each partner organization were thoroughly analyzed
during the meeting in Bratislava (November 2014) and were used in the
following period, in order to review the curriculum.
Application of questionnaires for self-assessment / evaluation of achievement
indicators after the first year of the project during the project meeting in
Bratislava (November 2014),
Firstly ,self-assessment was required by the leaders of the organization, and
then assessment was offered by the leaders of packages.

IV. Conclusions resulting

interpretation of results.

from

the

application

of

instruments

and

Results presented by partner organizations in interim reports and progress

reports were analyzed by reference to output indicators ,but also in the
dissemination activities.

Conclusions regarding the grant compliance and quality activities and

products were mostly good and very good. Several issues after each report
were identified and recommendations for improvement were made.

Firstly: Interim Report 1: recommended to partner organizations to revise

plans for dissemination in accordance with the recommendations of the
dissemination strategy.

Secondly: Interim Report 2: PCMNE recommended to send the required

documents on time in order to establish whether they applied the agreed
improvement solutions.

Thirdly ; Interim Report 3: because certain deficiencies were identified during

the
participation
of representatives of public institutions at working
meetings of stekholders, it is thus, recommended to diversify communication
strategies and intensify advocacy activities of the institutions concerned.

Fourthly: Interim Report 4: certain delays concerning the conclusions of

activities were identified by PCMNE.
The project meeting in Bratislava (November 2014) requested all partners to
complete a self-assessment grid. They were asked to assess the organizations
they represent
in the project, by reference to the result indicators
established during the first meeting and presented in M & E strategy and
tools.
In the second stage, leaders were invited to make a general descriptive
assessment (2-3 sentences) on the involvement of partner organizations in
carrying out the package they coordinate. The conclusions and default
recommendations following analysis of the responses were as follows:
CILDSGC (leader WP1, WP3, WP7): there were some delays in the timely
submission of documents and a certain inertia in communication.
IOE (WP4 leader): data required to complete certain research. PCMNE (WP5
leader): appreciates the commitment of partners.
ALV (WP2 leader, WP6) considers the feedback provided by the partners to be
really useful especially after the presentation of the literacy curriculum for
family and training of trainers organized in Cluj-Napoca in June 2014;
appreciates the support provided by IOE in linking curriculum with the needs
analysis results.
ORAVA (WP8 leader) , activities in the package coordinated by this leader
,were not conducted up to the date of the meeting.

They discussed concrete solutions to eliminate the deficiencies noted and

prevent disturbances / future risks.

Online questionnaires applied during the 4 project meetings .

Questionnaire in the Letra form distributed at final conference included
three categories of questions regarding:
organization
content
activities (specific questions on issues discussed with every
opportunity)
questions about the clarity of the tasks / problems to the next stage.
The findings were used to improve the organization of future meetings and to
increase the quality achieved by the project activities and products.
According to the respondents' statements, each meeting ended with each
participant understanding of the role and tasks that are to be done in the
near future.
Analysis of the completion of products and output indicators at the end of
the project in accordance with M & E strategy and tools occasioned the
following conclusions:
Needs analysis and research report complied with output indicators. It has
provided relevant information on disadvantaged groups and provided useful
and customized information for each target group, favouring the writing
and piloting of the Family Literacy program

Project activities were carried out totally , some while late, were recovered in
the course and did not prejudice the development of the project. Family
Literacy Curriculum complied with the output indicators, namely specificity,
reliability, relevance, utility, scope and credibility. Promotional materials
(leaflets, posters) were made in the number provided in English and in local
languages. It is characterized by clarity of the information, attractiveness and
relevance. They were distributed in environments considered to be of great
impact. Products of the project (local strategies, video presentations, ...) were

conducted in English and in local languages in the number of copies specified

in the project. They were distributed to all interested and appreciated due to
their clarity, consistency and usefulness.

V. General Conclusions
In terms of quality, it was also noted:
efficient project management
correct collaboration between partner organizations and project manager
application in the three countries of research tools and communication in the
terms established
the elaboration of the draft of the curriculum of literacy Family in time.
implementation and piloting curriculum activities, taking into account the
specificities of each country
realization of dissemination activities by each partner locally, nationally and
internationally.
reliable and consistent monitoring performed by the quality responsible
leader .
Inherently, there were some deviations from schedules established and some
problems, mainly related to the target group and piloting curriculum.
Having identified these issues and following an objective analysis performed
at the level of each partner and during project meetings, it was decided to
take corrective measures which were implemented promptly and proved to
be effective.

Drafted by:

Mariana Dragomir, ALV

December 2015