Skip to main content
  • Original basic research
  • Open access
  • Published:

Development of a microplate coagulation assay for Factor V in human plasma

Abstract

Background

Factor V (FV) in its activated form, FVa, is a critical regulator of thrombin generation during fibrin clot formation. There is a need of a simple, fast, and inexpensive microplate-based coagulation assay to measure the functional activity of FV in human plasma. The objective of this study was to develop a microplate-based assay that measures FV coagulation activity during clot formation in human plasma, which is currently not available.

Methods

The FV assay requires a kinetic microplate reader to measure the change in absorbance at 405nm during fibrin formation in human plasma. The FV assay accurately measures the time, initial rate, and extent of fibrin clot formation in human plasma.

Results

The FV microplate assay is simple, fast, economical, sensitive to approx 24-80pM, and multiple samples may be analyzed simultaneously. All the required materials are commercially available. Standard curves of time or initial rate of fibrin clot formation vs FV activity in the 1-stage assay (Without activation by thrombin) may be used to measure FV activity in samples of human plasma. The assay was used to demonstrate that in nine patients with disseminated intravascular coagulation (DIC), the FV 1-stage, 2-stage (With activation by thrombin), and total (2-stage activity - 1-stage activity) activities were decreased, on average, by approximately 54%, 44%, and 42%, respectively, from prolonged clot times when compared to normal pooled human reference plasma (NHP). The results indicate that the FV in the DIC patient plasmas supported both a delayed and slower rate of fibrin clot formation compared with NHP; however, the extent of fibrin clot formation in the DIC patients remained largely unchanged from that observed with NHP.

Conclusions

The FV microplate assay may be easily adapted to measure the activity of any coagulation factor using the appropriate factor-deficient plasma and clot initiating reagent. The microplate assay will find use in both research and clinical laboratories to provide measurement of the functional coagulation activity of FV in human plasma.

Background

The use of microplate-based assays for quantification of enzyme activity is now common practice in many laboratories for enzyme linked immunosorbant assays [1] and colorimetric enzyme assays using chromogenic substrates [2]. The two main advantages for microplate-based assays are use of small sample volumes and that multiple samples may be analyzed simultaneously. Several microplate assays have been previously reported for measurement of clot lysis [3], platelet aggregation [4], the activity of Factor (F) VII, VIII, IX and IXa, X, XI, XII, and activated protein C (APC) [5, 6]. General coagulation and fibrinolysis microplate assays have also been described [7]. Finally, although manual [8, 9] and automated [10] FV coagulation assays have been described, no microplate-based coagulation assay has been previously reported to measure FV activity in human plasma.

FV circulates in humans at approx 12-40nM as an inactive procofactor of Mr 330kDa [11]. In response to injury, activation of FV to the activated cofactor, FVa, occurs initially by thrombin [12]. FVa is a major regulatory component of coagulation where it accelerates thrombin generation and consequent fibrin clot formation as part of the prothrombinase enzyme complex [13]. In the presence of thrombomodulin, thrombin activates protein C to activated C (APC) which inactivates FV and FVa and downregulates coagulation as part of the normal anticoagulation response to injury [14]. The FV Leiden mutation (Arg 506 to Gln) results in FVa becoming resistant to APC inactivation and results in a hypercoagulable state in affected individuals [15]. The FV Leiden mutation is currently the most common genetic risk factor for venous thrombosis in humans [16].

Although methods for determining the FV 1-stage activity (Without activation by thrombin) in human plasma using manual tilt-tube assays have been described [8, 9], the results may be prone to operator bias. Further, these FV assays are time consuming because only one sample may be assayed at a time. Since FV circulates in plasma as an inactive procofactor [11], it must be 'intentionally' activated with added thrombin to generate FVa for accurate and complete measurement of the FV 2-stage activity (With activation by thrombin). The total FV activity may then be calculated using the measurements from FV 1- and 2-stage assays (Total FV activity = 2-stage activity - 1-stage activity). Methods for determining the FV 2-stage activity in plasma using tilt-tube [8, 9] and automated [10] formats have been described.

The equipment required to perform automated coagulation assays is expensive. Although these analyzers are generally used in clinical laboratories to measure clot times in patient plasmas, the rate and extent of clot formation are not routinely assessed. The FV microplate assay described here provides measurement of the time, initial rate, and extent of clot formation in human plasma in a fast and convenient manner. It may be easily adapted to measure the activity of any coagulation factor in the extrinsic, intrinsic, or common pathway using the appropriate factor-deficient plasma and clot initiating reagent. This new microplate-based coagulation assay will be useful in both research and clinical laboratories to increase our understanding of the biochemistry and functional activity of FV.

Materials and methods

Materials

Normal pooled human reference plasma (NHP) was obtained from Precision Biologicals (Dartmouth, NS, Canada) and was stored at -80°C until use. Fresh frozen human plasma was obtained from Lakeridge Healthcare (Oshawa, ON, Canada) and stored at -80°C until use. FV-deficient plasma was made from fresh frozen human plasma according to Bloom et al. [9], dialyzed exhaustively against 20mM HEPES, 0.15M NaCl, pH 7.4 (HBS), and stored at -80°C until use. The FV-deficient plasma contained less than 0.1% of the active FV present in the original fresh frozen human plasma. Thromboplastin reagent from Trinity Biotech (Wicklow, Ireland) was reconstituted with and dialyzed exhaustively against HBS at 4°C, and stored at -80°C until use. Dialysis was required to remove any calcium in this reagent in order to permit precisely timing the reaction from the time of addition of calcium chloride to initiate clotting (See below). Purified thrombin was prepared according to Bajzar et al. [17]. The nine patients studied were diagnosed with disseminated intravascular coagulation (DIC) at some point during their stay in the Intensive Care Unit of The Royal Liverpool University Hospital (Liverpool, UK) according to The International Society on Thrombosis and Haemostasis Scientific and Standardization Committee algorithm [18]. Patients were treated according to standard procedures and none received heparin or anticoagulant factor concentrates. Patient blood samples were drawn into 0.1 volume of 3.8% sodium citrate according to The Liverpool Research Ethics Committee and the plasma fractions were stored at -80°C until use. To determine the normal range of FV activity in the FV 1-stage microplate assay, approximately 4.5 ml of blood was drawn from 15 healthy subjects (Age 18-22 years) from the Medical Laboratory Science Program at The University of Ontario Institute of Technology into 0.5 ml of 3.8% sodium citrate and the plasma fractions were stored at -80°C until use. The research complied with all relevant laws, guidelines, and policies. Thawed/refrozen aliquots of NHP, FV-deficient plasma, thromboplastin, and patient plasma were not used for study.

Factor V Coagulation Assays

The FV microplate assay was performed in the wells of immunomodule strips (Nunc, Roskilde, Denmark) using a multichannel pipette to make simultaneous additions of FV-deficient plasma (50 μl), followed by normal or patient plasma diluted in HBS (50 μl), and finally thromboplastin (50 μl). The samples were incubated in a Spectra Max 190 microplate reader (Molecular Devices, Sunnyvale, CA, USA) at 25°C for 1 minute with shaking during the 15-25 seconds of the 1 minute incubation. Calcium chloride (50 μl of 25mM) was then added to initiate clotting. The samples were then shaken for 10 seconds and the absorbance at 405nm was read every 5 seconds for 6 minutes. The 10 seconds required for shaking prior to absorbance readings were not included in the calculated clot times. The clot times were calculated as the time to reach the midpoint between the minimum and maximum absorbance at 405nm after calcium chloride addition. The initial rate of clot formation was calculated as the rate of increase in absorbance at 405nm (mUnits/minute) using the first 5 time points of clot formation in the linear portion of the absorbance vs time curve. The extent of clot formation was calculated as the difference between the maximal and minimal absorbance in Units at 405nm achieved during the clot formation event.

The FV 1-stage activity of a plasma sample diluted 40-fold in HBS was determined by comparison to the FV 1-stage microplate assay standard curves of times or initial rates of clot formation vs FV activity measured upon serial dilution of NHP (0- to 1024-fold) in HBS. One unit of FV activity was defined as the activity in 1 ml of NHP prior to activation by thrombin (See below). Up to 12 samples were analyzed simultaneously using SOFTmax PRO 4.3 LS software (Molecular Devices, Sunnyvale, CA, USA). The above microplate assay measures the FV 1-stage activity (Without activation by thrombin) of a plasma sample. Since FV is activated with thrombin to the active cofactor, FVa [12], a second assay after addition and incubation with thrombin was critical to accurately measure the FV 2-stage (With activation by thrombin) cofactor activity of a plasma sample. For the FV 2-stage assay, purified thrombin (1 Unit/ml; 10nM final concentration) was added to the plasma sample diluted 100-fold in HBS and incubated for 1 minute at 37°C. The plasma sample was diluted a further 5-fold in HBS and re-assayed at a 500-fold dilution as described above. The FV 2-stage activity was interpolated from the FV 1-stage assay standard curve of time of clot formation vs FV activity (See above). The total FV activity was calculated from the measured values from the FV 2-stage and 1-stage assays and was defined as the 2-stage activity - 1-stage activity.

The results shown for the times and initial rates of clot formation in the FV 1-stage assay standard curves are representative of experiments conducted on greater than thirty different occasions. The intra- and inter-FV assay variability of the time, extent, and initial rate of clot formation were calculated from six samples of NHP diluted 40-fold in HBS on eight different days.

Results

A typical depiction of clot formation in the FV coagulation assay over time generated by the microplate reader is shown in Figure 1. Visual inspection of the wells after the assay was performed confirmed that clot formation took place. All reactions reached approximately the same extent of clot formation with a typical change in absorbance at 405nm of 0.35 - 0.45 Units between the starting absorbance before and the maximal absorbance after thromboplastin and calcium chloride addition.

Figure 1
figure 1

Monitoring clot formation in normal pooled human reference plasma with the kinetic microplate FV 1-stage coagulation assay. Fibrin clot formation in NHP was monitored at 405nm over time in a microplate reader. The profile represents the actual microplate reader output of a 6 minute reaction of 32-fold diluted NHP, FV-deficient plasma, thromboplastin, and calcium chloride in a single microplate well. The vertical axis denotes the change in absorbance at 405nm that occurred as a result of clot formation in plasma. The time of fibrin formation was defined as the time to reach the half maximal increase in absorbance; approximately the midpoint of curve (36.40 seconds). The initial rate of clot formation was defined as the rate of change of absorbance at 405nm over the first 5 time points of the linear increase of absorbance portion of the curve (611.88 mUnits/min). The extent of clot formation was defined as the difference between the maximum and minimum absorbance at 405nm (0.35 Units).

In order to measure the FV activity in a plasma sample, standard curves of time and initial rate of clot formation vs FV 1-stage activity were generated upon serial dilution of NHP. Fitting the Log-Log plot of clot time vs FV 1-stage activity demonstrated a strong linear relationship between these variables after regression analysis (Figure 2A; R2 = 0.980). Fitting of the Log-Log plot of the initial rate of clot formation vs FV 1-stage activity also demonstrated a strong linear relationship between these variables after regression analysis (Figure 2B; R2 = 0.983). The relationship of both clot time and initial rate of clot formation vs FV 1-stage activity remained linear in NHP diluted up to approx 1024-fold. Given that the FV concentration in NHP is approx 12-40nM [11], the results indicate that the assay is sensitive to approximately 24-80pM FV in NHP. Our results indicate that the normal range of FV activity in the FV 1-stage activity assay in 15 healthy controls assayed with the FV microplate assay was approximately (Mean ± Standard deviation; Range): 0.96 ± 0.14 U/ml; 0.68-1.11 U/ml. This is similar to the FV activity and range (0.66-1.14 U/ml) in healthy controls reported by Cutler et al. for the FV 1-stage activity measured with an automated analyzer [19].

Figure 2
figure 2

Standard curves of time and initial rate of clot formation vs Factor V activity in normal pooled human reference plasma using the FV 1-stage microplate assay. NHP was serially diluted (0- to 1024-fold in HBS) and assayed with the FV 1-stage microplate assay as described in the text. Log-Log plots of the times and initial rates of clot formation vs FV activity in the FV 1-stage microplate assay are shown after linear regression modelling of the results in panels A and B, respectively.

Under the conditions of the assay using 40-fold diluted NHP, the intra-assay variability of the time, extent, and initial rate of clot formation in the FV 1-stage assay among 6 wells on 8 different days was 3.4%, 4.4%, and 3.1%, respectively. The inter-assay variability of the time, extent, and initial rate of clot formation in the FV 1-stage assay among 6 wells of 8 different experiments on 8 different days was 7.1%, 7.8%, and 9.2%, respectively. Thus, the intra- and inter-assay variability of these three variables in the FV 1-stage assay was at a low and acceptable level.

The standard curve of clot time vs FV 1-stage activity (Figure 2A) was used to measure the FV activity in nine DIC patient plasmas which were (FV 2-stage activity) or were not (FV 1-stage activity) intentionally activated with thrombin and the results are shown in Table 1. All nine DIC patient plasmas exhibited FV 1-stage activities and initial rates of clot formation that were decreased on average, by approx 54% and 18%, respectively, from NHP. The extents of clot formation in the FV 1-stage assay in the DIC patients were not largely different from NHP, and increased on average, by approx 13% from NHP.

Table 1 FV Activity in NHP and in 9 Patients That Developed Disseminated Intravascular Coagulation (DIC)

Activation of NHP with thrombin generated an approximate 8-fold increase in FV 2-stage activity above the FV 1-stage activity (Table 1). This indicates that the FV in NHP was mainly present in its unactivated form and is consistent with the results reported by Nesheim et al. using a manual tilt-tube FV assay [8]. The FV 2-stage and total activity were also decreased in the DIC patients on average, by approx 44% and 42%, respectively, from NHP. The initial rates and extents of clot formation in the FV 2-stage assay in the DIC patients were not largely different from NHP, and varied on average, by approx 9% and 4%, respectively, from that observed with NHP.

Discussion

The kinetic microplate-based assay outlined here describes the development of a new, fast, economical, and simple technique for measurement of FV coagulation activity in samples of human plasma which has or has not been intentionally activated by thrombin. The assay requires a kinetic microplate reader and all the required reagents and materials are commercially available. The assay measures the increase in turbidity of plasma during clot formation at 405nm using a kinetic plate reader. The assay also has the added advantage of using small sample volumes (50 μl) as well as being able to analyze multiple samples simultaneously (up to 12). These assay characteristics are especially important and advantageous when expensive reagents are required such as factor-deficient plasmas; when only small sample volumes are available such as patient plasmas or when analyzing a large number of samples during purification of FV from plasma.

The results indicate that the FV in the DIC patient plasmas was functionally less active than in NHP because of prolonged clot times and decreased initial rates of clot formation in the FV 1-stage assay. However, the initial rates of clot formation in the FV 2-stage assay in the DIC patients were not largely different from NHP. The extents of clot formation in the DIC patient plasmas were also not largely different from NHP in the FV 1-stage and 2-stage assays. Since the extent of clot formation in the DIC patient plasmas was the same as observed with NHP, this was most likely determined by the fibrinogen level in the FV-depleted plasma and unrelated to characteristics of the patient plasmas.

These results indicate that the FV in the DIC patient plasmas supported both a delayed and slower rate of fibrin clot formation compared with NHP; however, the extent of fibrin clot formation in the DIC patients remained largely unchanged from that observed with NHP. Compared with NHP, the FV in the DIC patient plasmas was also on average, 44% less activatable with thrombin in the FV 2-stage assay. Finally, the FV total activity in the DIC patients decreased by approx 42% on average, from that observed in NHP. The decreased FV 1-stage, 2-stage, and total activities may have been due to increased FV consumption [20] and/or inactivation [21] which occurred during the pathogenesis of this acquired blood disorder in the patients studied. Our preliminary results indicate that the FV antigen levels in the DIC patient plasmas studied were not significantly different from NHP [11], which indicates a qualitative disorder of FV occurred in this condition.

The results of the microplate assay indicate that measurement of FV coagulation activity in human plasma samples may be obtained from the time and initial rate measurements of clot formation from the FV 1-stage assay and the time of clot formation and total activity measurement from the FV 2-stage assay. It was however not possible to obtain a quantitative measurement of FV coagulation activity in a plasma sample based on the extent of clot formation in the FV 1- and 2-stage assays or the initial rate of clot formation in the FV 2-stage assay. Since all reactions reached approximately the same extent of clot formation at 405nm of 0.35 - 0.45 Units between the starting absorbance before and the maximal absorbance after thromboplastin and calcium chloride addition, measurement of the extent of clot formation does not strictly provide a quantitative measurement of FV coagulant activity in any given plasma sample.

The new microplate assay will be useful in both clinical and research laboratories for measurement of FV activity in human plasma samples. The microplate assay may be used to measure the time, initial rate, and extent of clot formation; parameters not routinely monitored simultaneously in most automated coagulation analyzers. In its entirety, this quantitative information provides more of a complete 'picture' of the involvement of FV during the clot formation event in human plasma than has been previously reported [5, 7–10, 21]. This information, in turn, may be especially important in both research and clinical settings when assessing significant changes in FV activity in plasma samples or using purified FV or FVa. Other applications of the FV assay include its use to detect and measure compounds and substances that may activate or inactivate FV or FVa, measure the FV activity in patients at risk for venous thrombosis as a result of the FV Leiden mutation [15, 16], and to measure the FV activity during its purification from either human or animal plasma.

Conclusion

The FV microplate assay format may be easily adapted to measure the activity of any coagulation factor in the extrinsic, intrinsic, or common pathway using the appropriate factor-deficient plasma and clot initiating reagent. The clinical and research use of this new microplate-based coagulation assay will provide further information and understanding of FV biochemistry and functional activity in the future.

References

  1. Ihara M, Suzuki T, Kobayashi N, Goto J, Ueda H: Open-sandwich enzyme immunoassay for one-step noncompetitive detection of corticosteroid 11-deoxycortisol. Anal Chem 2009, 81: 8298-304. 10.1021/ac900700a

    Article  CAS  PubMed  Google Scholar 

  2. Janke R, Genzel Y, Wahl A, Reichl U: Measurement of key metabolic enzyme activities in mammalian cells using rapid and sensitive microplate-based assays. Biotechnol Bioeng 2010, 107: 566-81. 10.1002/bit.22817

    Article  CAS  PubMed  Google Scholar 

  3. Beebe DP, Aronson DL: An automated fibrinolysis assay performed in microtitre plates. Thromb Res 1987, 47: 123-128. 10.1016/0049-3848(87)90249-0

    Article  CAS  PubMed  Google Scholar 

  4. Frantantoni JC, Poindexter BJ: Measuring platelet aggregation with a microplate reader: a new technical approach to platelet aggregation studies. Am J Clin Pathol 1990, 94: 613-617.

    Google Scholar 

  5. Pratt CW, Monroe DM: Microplate coagulation assays. Biotechniques 1992, 13: 430-433.

    CAS  PubMed  Google Scholar 

  6. Carlebjörk G, Oswaldsson U, Rosén S: A simple and accurate microplate assay for the determination of factor VIII activity. Thromb Res 1987, 47: 5-14. 10.1016/0049-3848(87)90235-0

    Article  PubMed  Google Scholar 

  7. Goldenberg NA, Hathaway WE, Jacobson L, Manco-Johnson MJ: A new global assay of coagulation and fibrinolysis. Thromb Res 2005, 116: 345-56. 10.1016/j.thromres.2004.12.009

    Article  CAS  PubMed  Google Scholar 

  8. Nesheim ME, Katzmann JA, Tracy PB, Mann KG: Factor V. Methods Enzymol 1981, 80: 249-74.

    Article  CAS  PubMed  Google Scholar 

  9. Bloom JW, Nesheim ME, Mann KG: A rapid technique for the preparation of factor V deficient plasma. Thromb Res 1979, 15: 595-599. 10.1016/0049-3848(79)90169-5

    Article  CAS  PubMed  Google Scholar 

  10. Samis JA, Stewart KA, Nesheim ME, Taylor FB Jr: Factor V cleavage and inactivation are temporally associated with elevated elastase during experimental sepsis. J Thromb Haemost 2009, 5: 2559-61.

    Article  Google Scholar 

  11. Tracy PB, Eide LL, Bowie EJ, Mann KG: Radioimmunoassay of factor V in human plasma and platelets. Blood 1982, 60: 59-63.

    CAS  PubMed  Google Scholar 

  12. Orfeo T, Brufatto N, Nesheim ME, Xu H, Butenas S, Mann KG: The factor V activation paradox. J Biol Chem 2004, 279: 19580-91. 10.1074/jbc.M400727200

    Article  CAS  PubMed  Google Scholar 

  13. Bukys MA, Blum MA, Kim PY, Brufatto N, Nesheim ME, Kalafatis M: Incorporation of factor Va into prothrombinase is required for coordinated cleavage of prothrombin by factor Xa. J Biol Chem 2005, 280: 27393-401. 10.1074/jbc.M503435200

    Article  CAS  PubMed  Google Scholar 

  14. Kalafatis M, Rand MD, Mann KG: The mechanism of inactivation of human factor V and human factor Va by activated protein C. J Biol Chem 1994, 269: 31869-80.

    CAS  PubMed  Google Scholar 

  15. Dahlbäck B, Carlsson M, Svensson PJ: Familial thrombophilia due to a previously unrecognized mechanism characterized by poor anticoagulant response to activated protein C: prediction of a cofactor to activated protein C. Proc Natl Acad Sci USA 1993, 90: 1004-8. 10.1073/pnas.90.3.1004

    Article  PubMed Central  PubMed  Google Scholar 

  16. Dahlbäck B: Advances in understanding pathogenic mechanisms of thrombophilic disorders. Blood 2008, 112: 19-27. 10.1182/blood-2008-01-077909

    Article  PubMed  Google Scholar 

  17. Bajzar L, Manuel R, Nesheim ME: Purification and characterization of TAFI, a thrombin-activable fibrinolysis inhibitor. J Biol Chem 1995, 270: 14477-84. 10.1074/jbc.270.24.14477

    Article  CAS  PubMed  Google Scholar 

  18. Taylor FB Jr, Toh CH, Hoots WK, Wada H, Levi M: Towards definition, clinical and laboratory criteria, and a scoring system for disseminated intravascular coagulation. Thromb Haemost 2001, 86: 1327-30.

    CAS  PubMed  Google Scholar 

  19. Cutler JA, Patel R, Rangarajan S, Tait RC, Mitchell MJ: Molecular characterization of 11 novel mutations in patients with heterozygous and homozygous FV deficiency. Hemophilia 2010, 16: 937-42. 10.1111/j.1365-2516.2010.02330.x

    Article  CAS  Google Scholar 

  20. Mammen EF: Disseminated intravascular coagulation (DIC). Clin Lab Sci 2000, 13: 239-45.

    CAS  PubMed  Google Scholar 

  21. Samis JA, Stewart KA, Toh CH, Day A, Downey C, Nesheim ME: Temporal changes in factors associated with neutrophil elastase and coagulation in intensive care patients with a biphasic waveform and disseminated intravascular coagulation. J Thromb Haemost 2004, 2: 1535-44. 10.1111/j.1538-7836.2004.00826.x

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

This research was supported with Professional Development and Research Startup Funds from The University of Ontario Institute of Technology (JAS) and a Canadian Institutes of Health Research Health Professional Student Research Award (IL). The authors wish to thank Dr. Michael E. Nesheim (Department of Biochemistry, Queen's University, Kingston, ON) for his mentorship, helpful discussions, and caring nature which will always be treasured and fondly remembered. The authors also wish to acknowledge Dr. Cheng Hock Toh (Roald Dahl Haemostasis and Thrombosis Centre, Royal Liverpool University Hospital, Liverpool, UK) for generously providing the DIC patient plasmas.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to John A Samis.

Additional information

Declaration of Competing interests

The authors declare that they have no competing interests.

Authors' contributions

JAS supervised the study design, interpretation of results, manuscript preparation and wrote the manuscript. DT acquired and analyzed the data and helped write the manuscript. IL assisted DT in acquiring and analyzing some of the data and helped write the manuscript. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Tilley, D., Levit, I. & Samis, J.A. Development of a microplate coagulation assay for Factor V in human plasma. Thrombosis J 9, 11 (2011). https://doi.org/10.1186/1477-9560-9-11

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1477-9560-9-11

Keywords