H-Anim

From Web3D.org
Revision as of 18:33, 30 October 2013 by Brutzman (Talk | contribs) (4. Units)

Jump to: navigation, search

Humanoid Animation (H-Anim) WG Meeting

  • Regular Meetings: Wednesday at 5pm, PDT or PST for 1 hour
  • Next Meeting: October 30 (Wednesday), 2013, at 5pm, PDT
  • Agenda and Minutes

ISO Meeting

  • 2013 ISO/IEC JTC 1/SC 24 Plenary & WG Meetings, Sydney, Australia, August 26-30, 2013.
  • H-Anim proposals at WG6 meetings

Editor's note: links to uploaded images/documents available at http://web3d.org/wiki/index.php/Special:ListFiles

New work items and working draft

NWIP's scope and responsibility

Please add responsible persons for each item. We recommend that the persons of responsibility work on draft and/or examples for conformance.

  • 1) Definition of a humanoid character model capable of generating motion from captured motion data → Myeong and Joe
  • 2) Definition of a humanoid character model capable of generating motion using 3D scanner data → Myeong and William
  • 3) Definition of a humanoid character model capable of generating motion using a general motion definition such as keyframe, interpolation, kinematics, and dynamics for human figures → Myeong and Joe
  • 4) Definition of motion parameters for transferring or exchanging motion between different human character models → Myeong and Dick
  • 5) Definition of a motion data interface for including motion data → Myeong and Dick
  • 6) Definition of a motion viewer’s functionality → Myeong and Joe
  • 7) Definition of interoperable human behavior prototypes → Don, Myeong and William
  • 8) Guidelines for adding 3D skinning to humanoid characters → Joe and Don
  • 9) Definition of a recording interface for human motion such as gait → Don and William
  • 10) Provision for easier exchange of characters from design systems to H-Anim systems. → Myeong and Joe

This work is intended to define a standard model for humanoid animation including motion interfaces. It is an enhancement to the original H-Anim model of ISO/IEC 19774, and ISO/IEC 19774 Working Draft Amendment (WDAM) 1 in progress.

Document plan

  • The motion-related work is expected to be integrated with the 19774 specification and the 19774 WDAM 1 documents into a new document.
  • It may become appropriate and necessary to split the revised 19774 specification into multiple parts.

Formal submission of the H-Anim NWIP to ISO depends on working-group preparation of

  • Initial Committee Draft (CD) specification text
  • At least one draft implementation (with plans for a second)
  • Working examples, validation, quality assurance (QA)

New proposals submitted to H-Anim WG

  • 2013-07-21, H-Anim Facial Animation, Prof. Jung-Ju Choi (Ajou Univresity, Korea) FA_HAnim_LA20130721
  • 2013-07-21, Modeling and Animation of Hands and Feet, Prof. Kwan-Hee You (Chungbuk National University, Korea) HandAndFeetAnimation130821

Procedure for H-Anim character design

H-Anim wrl to x3d converter

H-Anim LOA Figures

Previous work

Resources

H-Anim Behavior Prototypes

Prototypes for HAnimBehavior node, which collects OrientationInterpolators for aggregate animation of an H-Anim humanoid model, and

HAnimBodyBehaviorChooser, which selects one body and enables/disables multiple aggregate behaviors.

H-Anim examples designed with a general tool (10 H-Anim characters)

Standards Development: Specifications

Two primary specifications govern this work: the X3D and the H-Anim International Standards. The H-Anim standard describes functional information in full detail, while the X3D specification simply references this work and maps constructs into X3D nomenclature. Working group members: only refer to the official version as we confirm current capabilities and rejuvenate future work.

X3D v3.3 specification, H-Anim Component

H-Anim specification, current

H-Anim specification, incomplete draft change

  • H-Anim Working Draft Amendment WDAM1
    • http://igraphics.com/Standards/ISO_IEC_19774_WAM1_2009_01_12/index.html
    • This draft amendment proposed new capabilities for H-Anim and is a reasonably complete document.
    • It was never approved by Web3D Consortium nor submitted to ISO.
    • We are interested in learning whether any implementations exist that demonstrate these proposed changes.
    • It stalled when working group activity ceased circa January 2009.
    • Added items in this draft "change document" can be reconsidered by the reactivated working group.
H-Anim specification, historical efforts
Note: the following versions have no official standing and are no longer active.
* Intermediate draft version, ISO/IEC 19774:2005
** http://www.web3d.org/x3d/specifications/ISO-IEC-19774-HumanoidAnimation/HAnim/HAnim.html
* H-Anim 200x specification (ISO_IEC_FCD_19774)
** http://h-anim.org/Specifications/H-Anim200x/ISO_IEC_FCD_19774
* H-Anim working group version 1.1, unofficial 
** http://h-anim.org/Specifications/H-Anim1.1
* H-Anim working group version 1.0, unofficial 
** http://h-anim.org/Specifications/H-Anim1.0

H-Anim WG Charter

WG Members

  • Myeong Won Lee (Chair)
  • William O. Glascoe III (Co-Chair)
  • Joe D. Williams (Subject Matter Expert)
  • Sandy Ressler
  • Keith Victor
  • David Bruner
  • Anita Havele
  • Richard F. Puk
  • Don Brutzman
  • Jung-Ju Choi
  • Kwan-Hee Yoo

Use Cases

Working Group chairs keep the following pages up to date:

  • We estimate there are upwards of 1,000 H-Anim Use Cases to fully characterize the human experience from the time all the bones of a human are formed or developed through

final disposition of the human body (mummification, cremation, burial, etc.). The vocabulary for human behavior (including misbehaving in all cultures, societies, etc.) serves as our baseline. Ontologies, taxonomies, classifications, encyclopedia and handbooks for human behavior are starting points for deriving the skeletal and skin motions for each concept, term and are categorized by:

1. duration of animation (measured in seconds: 3 - 30,000) 2. total joint angle displacement (displacement spectrum-percent of total possible displacement per joint) 3. angular rate of displaced joints (displacement speed spectrum - percent of maximum displacement) 4. simultaneity of joint displacement (percent of total joints in motion)

Moreover, this Working Group shall bin Use Cases in to those the WG are 1) likely to prototype 2) not likely to prototype and 3) will not prototype.

The complexity and duration of H-Anim scenes will correlate with the (actions) terms, (motions) concepts and (movements) behaviors of humans in natural and man-made environments with and without constraints of hand-held objects, clothing, etc.

Below are sample H-Anim Customer Segments (Authors and Consumers):

  • Use Cases (titles only) by Customer Segment (Authors and Consumers):

High Schoolers (half gross and half fine motor control)

Animate individual performance on sport team using official contest
times (and/or video footage, body sensors, MoCap, etc.) <6 minutes
Animate a schoolyard fight between only two students (<4 minutes)
Animate his/her character in a school play's scene (< 5 minutes)
Undergraduates (some fine motor control)
Animate assembly of consumer product requiring three or more tools
and the assistance of another person (<15 minutes)
Animate the operation of a motor vehicle's controls while the vehicle
is in motion (<15 minutes)
Animate the operation of a human powered vehicle on various surfaces
(<10 minutes)
Graduates (a lot of fine motor control)
Animate playing a musical instrument during a concert performance (<
15 minutes)
Animate folding a load of functionally realistic clothes (< 20 minutes)
Animate hunting wild game (<20 minutes)
Post-Graduates
Animate four classes of surgical procedures with Bio-CAD and
patients' images (replacement, implantation, ...tetomy and
transplantation) [<60 minutes]
Animate a job interview for a white collar position (e.g., Chief
Executive Officer of a mid-size corporation) [<30 minutes]
Animate dying (fratricide, suicide and homicide) [<15 minutes]
Professionals
Animate long duration spaceflight effects [<180 minutes; representing
18,000 minutes]
Animate the bends (scuba diving incident) [<60 minutes]
Animate drug addiction [<60 minutes]

Current Work

Working group chairs keep the following pages up to date:

Joe and Don are working each Monday night [1700-1900 pacific, Web3D teleconference line) on

  • As those issues get sorted out, we are re-visiting all the important details regarding H-Anim skinning
    • Definitions, example test scenes, tool support
    • Proposing an improved H-Anim component for X3D v3.4
    • Editing a corresponding update to H-Anim ISO 19774 Specification

The larger group is also working on

  • interoperable, swappable behaviors
  • motion capture
  • facial animation

Anthropometry

Published References for review and citation

Ergonomic Models of Anthropometry, Human Biomechanics and Operator-Equipment Interfaces: Proceedings of a Workshop ( 1988 )

Professional Societies: Professional Certifications, Licenses in Anthropometry International Standards: ISO - Basic human body measurements for technological design -- Part 1: Body measurement definitions and landmarks IEEE -

North American Standards:

ANSI

South, Central, Latin American Standards:

European, Middle Eastern and African Standards:

Asian Standards:

Before

This wiki page is the site for the recently renewed Humanoid Animation (H-Anim) Working Group.

Humanoid Animation (H-Anim) WG Meeting

March 2012: H-Anim Working Group Draft Charter materials by Web3D Korean Chapter

Links of interest:

There has been previous work by the H-Anim working group during 2008-2009 that was not completed. Here are some additional links on the members-only wiki:

Much additional work has been proposed by the Korea Chapter.

  1. Definition of a humanoid character model capable of generating motion from captured motion data
  2. Definition of a humanoid character model capable of generating motion using a general motion definition such as keyframe, interpolation, kinematics and dynamics for human figures.
  3. Definition of motion parameters for transferring or exchanging motion between different human character models
  4. Definition of motion data interface for including motion data
  5. Definition of behavior modeling data
  6. Definition of motion viewer’s functionality
  7. Video human functionality and gestures will be considered in AR/MR working group efforts

We agreed on the 1 Feb 2012 teleconference that it is a good idea to document work on these many good ideas using this H-Anim public wiki. Further comment is welcome about this.

The main thing that is needed next is to get the H-Anim Working Group restarted and rejuvenated.

  • H-Anim WG Charter
  • TODO: we need 1-2 members who are willing to volunteer to serve as working group co-chairs.
  • Working Draft for the H-Anim motion definition (in preparation) H-Anim Motion Definition

William's Section!

Human joint articulation of any type (there are six) can be expressed using Euler angles or quaternions. The word quaternion is modified based on how it is used--rotation, orientation or attitude modifiers are germane but there are others for different use cases. There are multiple approaches to convert Euler angles into quaternions (http://en.wikipedia.org/wiki/Hamilton_product#Hamilton_product, http://en.wikipedia.org/wiki/Quaternions_and_spatial_rotation).

BVH conversion issues

Myeong Won Lee example: http://web3d.org/wiki/images/4/4b/197_a.bvh.txt

Proposed investigation procedure: divide and conquer! Let's take each skeleton apart and put them back together again.


1. Is there an X3D H-Anim skeleton that corresponds to the BVH ROOT/JOINT HIERARCHY?

The structures used by BVH and H-Anim are different. There is not a direct correspondence between them. Differences include:

  • The hierarchical nesting of parent-child relationships is different
  • Values are therefore in different coordinate frames (one might be relative to parent joint, the other absolute coordinates for the human)
  • Formats are quite different
  • (others will be listed here)

2. However many similarities also exist. Maybe they can be exploited?

Perhaps we can build a mapping between the two. If we perform rotation transformations, a conversion algorithm can be computed for each hierarchy and corresponding units.

Here is a possible set of correspondences between a BVH model and an X3D H-Anim LOA-1 model.

  • BVH :: X3D H-Anim
    • ROOT :: HAnimHumanoid
    • JOINT :: HAnimJoint
      • JOINT name:: HAnimJoint name
      • OFFSET :: HAnimJoint center
    • CHANNEL definitions :: HAnimJoint rotation, translation
      • MOTION array of Euler-degree rotations :: OrientationInterpolator MFRotation array with ROUTE connections
      • CHANNEL array of position translations :: PositionInterpolator MFVec3f array with ROUTE connections
    • End Site :: HAnimSite
    • Anything else?

TODO

  • map the BVH names to the approved H-Anim X3D names.

3. Once we have the skeleton mapping, we can work on the animation values.

Let's look at the BVH file next. Hypothesis:

  • BVH MOTION arrays providing Zrotation Xrotation Yrotation values

to

  • corresponding MFRotation arrays with 4-tuple SFRotation values

Example reconstruction follows. First is an extract from the BVH file, then a counting exercise of how many floats appear.

 * ROOT Hips
   CHANNELS 6 Xposition Yposition Zposition Zrotation Xrotation Yrotation
   * JOINT Chest
     CHANNELS 3 Zrotation Xrotation Yrotation
     * JOINT LeftCollar
       CHANNELS 3 Zrotation Xrotation Yrotation
       * JOINT LeftShoulder
         CHANNELS 3 Zrotation Xrotation Yrotation
         * JOINT LeftElbow
           CHANNELS 3 Zrotation Xrotation Yrotation
           * JOINT LeftWrist
             CHANNELS 3 Zrotation Xrotation Yrotation
     * JOINT RightCollar
       CHANNELS 3 Zrotation Xrotation Yrotation
       * JOINT RightShoulder
         CHANNELS 3 Zrotation Xrotation Yrotation
         * JOINT RightElbow
           CHANNELS 3 Zrotation Xrotation Yrotation
         * JOINT RightWrist
           CHANNELS 3 Zrotation Xrotation
     * JOINT Neck
       CHANNELS 3 Zrotation Xrotation Yrotation
       * JOINT Head
         CHANNELS 3 Zrotation Xrotation Yrotation
   * JOINT LeftHip
     CHANNELS 3 Zrotation Xrotation Yrotation
     * JOINT LeftKnee
      CHANNELS 3 Zrotation Xrotation Yrotation
      * JOINT LeftAnkle
        CHANNELS 3 Zrotation Xrotation Yrotation
   * JOINT RightHip
     CHANNELS 3 Zrotation Xrotation Yrotation
     * JOINT RightKnee
       CHANNELS 3 Zrotation Xrotation Yrotation
       * JOINT RightAnkle
       * CHANNELS 3 Zrotation Xrotation Yrotation

Defines a MOTION array consisting of numeric values:

 3 floats [Hip location]
 3 floats [Hip rotation]
 3 floats [Chest rotation]
 3 floats [LeftCollar rotation]
 3 floats [LeftShoulder rotation]
 3 floats [LeftElbow rotation]
 3 floats [LeftWrist rotation]
 3 floats [RightCollar rotation]
 3 floats [RightShoulder rotation]
 3 floats [RightElbow rotation]
 3 floats [RightWrist rotation]
 3 floats [Neck rotation]
 3 floats [Head rotation]
 3 floats [LeftHip rotation]
 3 floats [LeftKnee rotation]
 3 floats [LeftAnkle rotation]
 3 floats [RightHip rotation]
 3 floats [RightKnee rotation]
 3 floats [RightAnkle rotation]
 = 19*3 = 54 floats

Each line of the MOTION data has 19 triples. Therefore we do have a good match.


4. Units

Length

  • BVH position units: author-defined?
  • X3D position units: 3-tuple x-y-z meters relative to point between feet on floor

Angle

  • BVH orientation units: roll-pitch-yaw Euler angles in degrees
  • X3D rotation units: SFRotation 4-tuple, normalized x-y-z axis vector, angle radians



5. The arrays can then be driven by a TimeSensor and key values at frame-time increments of 0.016667


5. How to convert?

With a little debugging, we can then combine the pieces to show corresponding animations in HAnim and BVH. We can build an application program (or even a Script node) that uses these mappings.


BVH references of possible value

Questions (2013-10-16)

  • Excerpted from 1Jin_new20130730.x3d

   <Group DEF='WalkAnimation'>
     <TimeSensor DEF='WalkTimer' cycleInterval='1.73' enabled='true' loop='true'/>
     <OrientationInterpolator DEF='Walk_r_kneeRotInterp' key='0 0.125 0.2083 0.2917 0.375 0.5 0.6667 0.7917 0.9167 1' 
     keyValue='1 0 0 0.8573 1 0 0 0.8926 1 0 0 0.5351 1 0 0 0.1756 1 0 0 0.1194 1 0 0 0.3153 1 0 0 0.09354 1 0 0 0.08558 
     1 0 0 0.2475 1 0 0 0.8573'/>
     <ROUTE fromField='fraction_changed' fromNode='WalkTimer' toField='set_fraction' toNode='Walk_r_kneeRotInterp'/>
     <ROUTE fromField='value_changed' fromNode='Run_r_kneeRotInterp_Run' toField='rotation' toNode='hanim_r_knee'/>